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NAIMTAIMA&ILIiy  TBCHHIQUE  STUDY 
PORENARD 

nt«  objective  of  this  program  waa  to  Inveatlgate  the 
factora  Which  Influence  the  maintainability  of  Air 
Force  electronic  equipment  and  further,  to  identify 
and  measure  these  factora  to  provide  a  quahtltatlve 
methodology  for  specifying  and  predicting  the  main¬ 
tainability  of  new  systems  and  e^ipment.  These 
Objectives  were  met  through  the  implMaentation  of  a 
five  (5)  phase  program.  An  extensive  field  data 
collection  program,  necessary  because  of  the  lack  of 
basic  tlme-to-repalr  data,  made  it  possible  to 
identify  and  measure  the  primary  factors  affecting 
ability  to  perform  maintenance.  .  Analysis  of  the 
data  and  application  of  statistical  techniques  re¬ 
sulted  in  the  formulation  of  a  Maintainability  Pre¬ 
diction  Technique,  thus  meeting  the  original  pro¬ 
gram  objectives. 


The  results  of  this  study  have  already  found  appli¬ 
cation  in  a  number  of  Air  Force  contracts  and  are 
reflected  in  the  measurement  and  demonstration 
procedures  described  in  Appendix  A  of  Specification 
NIL-M-26512B  "Maintainability  Requirements  for 
Aerospace  Systems  and  Equipment."  The  resulta 
of  this  study  will  find  greatest  application  to 
electronic  systems.  Further  investigation  is 
needed  to  prove  its  validity  in  electromechanical 
systems . 


FRANK  D.  MAZZOLA,  Project  Engineer 
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AB8TI(ACT 


niia  report,  contained  In  two  volumes,  summarises  the  final 
results  achieved  in  the  performance  of  the  Maintainability 
Techniques  Stud^  sponsored  by  the  Rome  Air  Development 
Center  under  Contract  AF30 (602) 2057.  The  broad  objective 
of  this  stu4y  was  the  formulation  of  a  maintainability 
technology  applicable  to  ground  electronic  systems. 

Volume  1.  describes  the  investigations  made  to  (1)  identify 
factors  affecting  maintainability.  (2)  specify  maintaina¬ 
bility  on  a  quantitative  basis.  (3)  improve  deiign  of  ground 
electronic  equipment.  (4)  predict  maintainability  of  elec¬ 
tronic  systems,  and  (5)  derive  trade-offs  relating  relia¬ 
bility.  maintainability,  and  other  system  parameters. 
Particular  emphasis  is  given  to  the  fifth  phase  of  study 
%dilch  was  devoted  to  validation  of  the  prediction  technique 
and  the  investigation  of  the  Blectronlc  Maintenance 
Proficiency  Test.  The  volume  is  concluded  hy  noting  the 
current  status  of  maintainability  technology  and  reccaoMnding 
areas  for  additional  research. 

Volume  II  is  a  compilation  of  the  analytical  techniques 
and  related  maintainability  information  developed  in  the 
course  of  the  stu([^.  Topics  treated  Includet  maintenance 
theory  and  classification,  systems  maintenance  engineering, 
design  guidelines,  prediction  technique,  design  review, 
denmnstratlon  testing,  and  field  data  acquisition. 
Collectively,  this  information  forms  a  body  ot  knowledge 
useful  to  the  maintainability  engineer. 
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MAINTAIMABILITY  TECHNIQUES  STUDY 
FINAL  TECHNICAL  REPORT 
(PHASE  V) 


1.  INTRODUCTION 

1.1  Purpose  of  the  Report 

This  report  presents  the  final  review  of  the  results 
achieved  in  the  performance  of  the  Maintainability  Techniques 
Stu(^  sponsored  by  the  Rome  Air  Development  Center  under 
Contract  AF  30 (602) -2057.  To  provide  maximum  utility  of 
the  information  derived,  this  report  has  been  divided  into 
two  volumes.  Volume  I  presents  a  complete  review  of  the 
total  program  including  the  experimental  procedure  plus 
the  results  achieved.  Considerable  detail  is  provided 
concerning  the  validation  work  performed  during  Phase  V 
of  the  research  program.  Volume  II  is  a  compilation  of 
the  maintainability  engineering  techniques  developed  by 
the  stu(fy.  It  is  intended  that  the  second  volume  will 
form  a  ready  reference  document  for  the  maintainability 
engineer. 

1.2  Study  Objectives 

The  maintainability  technique  study  was  directed  toward 
the  broad  objectives  of  Increased  availability  of  Air 
Force  systems,  and  the  reduction  of  system  support  cost 
during  service  life.  To  achieve  these  objectives,  means 
for  quantitative  evaluation  and  control  of  maintainability 
during  the  system  life  cycle  were  sought.  Specifically, 
the  stuc^  sought  to  accomplish  the  following^ 

a.  Identification  of  the  factors  influencing  main¬ 
tainability  and  the  formulation  of  methods  for 
measuring  the  magnitude  of  these  factors. 

b.  Development  of  mathematical  relations  between  the 
maintainability  factors  and  maintenance  time, 
permitting  the  formulation  of  a  prediction 
technique . 

c.  Establishment  of  means  for  specifying  maintain¬ 
ability  on  a  quantitative  basis. 
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d.  Providing  criteria  for  design  guidance  to  improve 
ground  electronic  equipment  maintainability. 

e.  Deriving  trade-off  relations  between  reliability« 
maintainability,  and  cost. 

Ibe  analytical  tools  provided  by  accomplishment  of  the 
above  would  contribute  significantly  to  establishing 
maintainability  as  a  well  defined  technology. 

1.3  Study  Program 

nie  research  program  designed  to  accomplish  the  above  stat¬ 
ed  objectives  consisted  of  five  formal  stages  as  described 
belowt 

a.  Phase  I  -  Design  of  Research  Plan 

The  plan  formulated  a  group  of  factors  believed 
to  affect  maintainability.  Methods  of  information 
acquisition  for  laboratory  experiments  and  field 
observation  were  developed.  Techniques  of  analysis 
leading  to  the  formulation  of  a  prediction  methodo¬ 
logy  were  developed.  Finally,  a  trial  application 
and  validation  procedure  was  outlined.  Ihe  Phase  X 
portion  of  this  research  postulated  many  of  the 
factors  that  affect  maintainability,  and  developed 
preliminary  methods  of  measurement  for  these  factors. 

Phase  II  -  Field  and  Laboratory  Data  Collection 

Three  representative  ground  electronic  equipments 
were  selected  as  study  vehicles.  Information 
relative  to  equipment  design,  and  support  factors 
was  collected  at  a  number  of  operational  field 
sites  and  at  three  semi -controlled  laboratory 
locations.  The  approach  consisted  of  measuring 
maintenance  task  performance  during  normal  operation 
at  field  sites.  For  the  laboratory  programs, 
maintenance  tasks  were  simulated  through  a  carefully 
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designed  schedule  of  malfunction  or  faults.  For 
both  field  and  laboratory  programs  maintenance 
task  time  measurements  were  recorded  In  conjunction 
with  a  quantitative  evaluation  of  equipment  design, 
scoring  of  personnel  factors,  and  rating  of  support 
factors  that  affect  the  maintenance  task. 

During  this  phase  certain  modification  of  the 
measurement  methods  postulated  during  Phase  I 
were  accomplished.  Ihe  relation  of  maintainability 
to  the  elements  of  design  and  logistic  support 
were  determined  during  the  data  collection  and  pre¬ 
liminary  zmalysls  phase  of  effort. 

c.  Phase  III  -  Data  Reduction  and  Analysis 

During  this  phase  a  comprehensive  analysis  of  all 
field  and  laboratory  data  was  performed.  Pre¬ 
liminary  analyses  of  portions  of  the  data  were  made 
euid  quantitative  expressions  for  maintainability 
In  terms  of  malntenemce  time  were  derived.  Ihe 
major  elements  of  design,  personnel,  and  support 
that  contribute  to  time  were  Isolated.  Mainte¬ 
nance  Indices  appropriate  In  describing  main¬ 
tainability  were  developed.  Ihese  measures  are 
useful  In  determining  maintainability  levels  for 
present  equipment,  for  comparison  with  other  types 
of  equipment  within  the  Air  Force  inventory,  and 
in  establishment  of  state-of-the-art  guidelines 
for  evaluation  of  new  designs  and  modification  of 
support  structure. 

d.  Phase  IV  -  Development  of  Prediction  Method 

The  Information  collected  and  reduced  during  Phases 
II  and  III  constituted  a  body  of  knowledge  from 
which  the  relation  of  equipment  maintenance  to 
design,  personnel,  and  support  factors  was  deter¬ 
mined.  Regression  and  correlation  techniques 
were  used  to  Isolate  the  significant  relations  and  to 
determine  the  relative  magnitude  of  the  many  factors 


4 


that  make  up  the  numerical  expression  of  main¬ 
tainability.  The  prediction  methodology  developed 
will  make  possible  design  cycle  control  of  new 
systems  based  upon  quantitative  knowledge  of  main¬ 
tainability  factors. 

e.  Phase  V  -  Trial  Application  and  Validation 

This  phase  consisted  of  a  trial  application  of  the 
prediction  method  using  an  existing  equlpmenu  not 
previously  studied  or  evaluated  for  its  maintaina¬ 
bility.  nie  prediction  Included  both  an  early 
assessment  based  on  preliminary  system  planning 
and  a  more  detailed  design  review  amd  prediction 
later  in  the  development  cycle.  A  field  stud^  was 
performed  subsequent  to  the  prediction.  Hie  data 
derived  through  the  observation  of  actual  mainte¬ 
nance  activity «  when  compared  to  the  predicted 
values t  were  significantly  related.  This  finding 
established  the  validity  of  the  technique. 

1.4  Summary  of  Contents 

This  volume  presents  in  Section  2  a  review  of  the  results 
achieved  by  the  study.  Comments  are  made  concerning  the 
degree  to  which  each  of  the  desired  objectives  were  ob¬ 
tained.  Section  3  contains  a  complete  review  of  the  major 
investigation  phases  accomplished  during  the  course  of 
the  Phase  V  program.  Included  in  this  review  are  dlsscus- 
slons  concerning  the  validation  of  the  prediction  technique » 
Electronic . Maintenance  Proficiency  Test,  investigating  and 
general  refinement  of  the  developed  maintainability 
technology.  Section  4  reviews  the  current  maintainability 
state-of-the-art  and  provides  recommendations  for  con¬ 
tinued  research.  Appendices  I  and  II  contains  the  supporting 
data  used  in  the  Phase  V  program. 


2 .  PROGRAM  RESULTS 


2.1  Factor  Identification 

During  the  formulation  of  the  program  plan.  It  was 
recognized  that  maintainability  could  be  evaluated  In 
terms  of  several  parameters  Including  cost.  time,  and  other 
Important  consequences.  Of  these.  It  was  considered  that 
time  was  the  most  basic  and  of  Immediate  concern.  The  plan 
formulated  called  for  a  broad  Investigation  of  those  factors 
which  were  considered  directly  to  affect  maintenance  time. 
Figure  2.1.  "Maintainability  Factors."  Identifies  those 
which  were  studied.  It  will  be  noted  that  equipment 
design,  technical  personnel,  and  the  maintenance  support 
environment,  were  considered  the  major  parameters.  Ml thin 
each  parameter,  a  number  of  factors,  considered  to 
Influence  maintenance  time,  were  established.  The 
Identification  of  these  factors  thus  fulfilled  one  part 
of  the  first  program  objective. 

2.2  Measurement  Techniques 

2.2.1  Factor  Measurement  -  To  determine  the  relations 
of  these  factors  to  maintenance  It  was  necessary  to  secure 
data  concerning  their  magnitude.  This  was  accomplished  by 
developing  a  checklist  for  each  factor.  These  checklists 
consisted  of  a  series  of  questions  appropriate  to  the 
factor  being  evaluated.  These  checklists,  scored  with 
reference  to  the  factor  characteristics  for  a  particular 
task,  provided  a  measurement  of  the  maintenance  condition. 
Scoring  data  for  a  large  group  of  tasks  thus  provided 
Information  which,  when  subsequently  analyzed,  permitted 
the  relating  of  the  maintenance  factors  to  maintenance 
time. 


2.2.2  Time  Measurement  -  Supplementary  to  the  factor 
measurement,  time  data  concerning  maintenance  performance 
was  obtained.  Standard  time  study  techniques  were  utilized 
to  develop  all  task  time  measurements.  A  work  sampling 
plan  was  utilized  to  analyze  the  total  activity  of  the 
maintenance  technicians  assigned. 

2.2.3  Profflclencv  Measurement  -  Within  the 

area,  the  Electronics  Maintenance  Profficiency  Teat  (EMPT) , 


7 


was  a  spaclally  constructed  measurement  device  designed 
to  assess  technical  capability.  This  test  was  patterned 
after  Intellegence  tests  but  was  developed  In  an  electronic 
context. 


2.2.4  The  formulation  of  these  measurement  techniques 
completed  the  first  program  objectives.  After  Initial 
establishment!  refinement  of  the  techniques  was  ecconqpllshed 
several  times  during  the  program. 

2.3  Pggdlg^jqn,.  RelaUgQi 

Ihe  time  and  scoring  data  collected  In  the  course  of  the 
field  program  were  submitted  to  a  simple  correlation 
analysis  to  Identify  those  factors  affecting  maintenance 
time.  Factors  %irhlch  appeared  to  relate  significantly! 
were  then  submitted  to  a  partial  correlation  analysis  to 
remove  Interactive  effects.  Table  2. "Partial  Correlation 
Coefficients,"  presents  the  results  of  this  analysis. 

Here,  the  entries  A,  B,  C^^,  imd  C2  represent  the  design 


TABLE  2.1 

PARTIAL  CORRELATION  COEFFICIENTS 
(N  «  101) 


h 

£ 

SI 

S2. 

A 

A 

A 

- 

.07034 

.02057 

. 01043 

.01407 

-.55804** 

B 

- 

.23063* 

-.30900** 

.29283** 

-.27893** 

Cl 

- 

.33358** 

.00536 

-.04668 

C2 

.20207* 

-.16162 

8 

- 

-.18906 

Z 

- 

** 

196  Slg. 

-  .260 

* 

596  Slg. 

-  .200 

factors  while  S  is  a  ccxnposlte  measure  of  the  support 
environment.  Maintenance  time  Is  denoted  as  Z  which  Is 
the  log  of  real  down  time  values.  This  examination  showed 
that  of  physical  design  features  (A)  and  facilities 
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requirements  (B)  were  related  to  maintenance  time  with 
design  dictates-skills  (C2)  and  support  (S)  as  possible 
contributors.  Subsequent^ examinations  established 
factors  Ai  B,  and  to  be  the  best  condslnation  for 
system  design  phase^ prediction.  A  mathmnatical  equation 
enbo^ing  these  terms  was  developed*  permitting  the  for¬ 
mulation  of  the  prediction  technique*  thus  fulfilling  the 
second  program  objective. 

2.4  Time  Specification; 

From  the  study*  the  characteristics  of  maintenance  time 
were  determined*  thus  leading  to  a  system  of  time  indices. 
The  suitability  of  the  log-normal  distribution  as  a 
descriptive  parameter  was  established.  Figure  2.2* 
"Frequency  Distribution  of  Down  Time*"  Illustrates  a 
typical  observed  log-normal  relation.  Through  the  de¬ 
tailed  examination  of  the  maintenance  process  an  appropriate 
classification  method  was  developed*  providing  a  means  for 
maintenance  time  specification.  This  development  fulfills 
the  third  program  objective. 

2.5  Design  Criteria 

Frcxa  the  data  gathered  In  the  stud^*  Information  useful 
for  formulating  design  guidelines  was  obtained.  These 
guidelines  take  several  forms.  First*  within  the 
design  area*  an  ordered  list  of  features  has  been 
developed  which  permits  decisions  to  be  made  concerning 
the  relative  Importance  of  alternate  designs.  Within  the 
personnel  area*  Information  concerning  the  average 
maintenance  mem  has  been  formulated  to  assist  the  designer 
In  developing  equipment  coianensurate  with  available 
skills.  Checklist  data  developed  for  the  support  area 
forms  a  means  of  assessing  the  design-support  environment 
compatablllty.  Jointly*  the  criteria  provide  Information 
concerning  design,  personnel*  and  support  which  will 
assist  the  designers  In  developing  a  system  compatable  with 
the  major  factors  affecting  maintainability.  These 
design  criteria  fulfilled  the  fourth  program  objective. 
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FIGURE  2.2.  FREQUENCY  DISTRIBUTION  OF  DOWN  TIME 
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2.6  Trade  off  Techniques 

Hie  prediction  technique  permits  the  examination  of 
maintainability  design  and  support  features  in  terms  of 
maintenance  time.  Through  the  use  of  the  availability 
relation  between  reliability  and  maintainability,  it  is 
possible  to  investigate  the  impact  of  such  features  at 
the  system  level.  Repeated  investigation  of  alternate 
configurations,  permits  optimum  selections  to  be  made. 
Additionally,  coat  Implications  may  be  included  in  the 
examinations,  thus  providing  optimization  among  major 
system  parameters.  Ihis  technique  fulfills  the  final 
objective  of  the  study. 

2.7  Summary 

nie  preceding  discussion  has  highlighted  the  results  of 
the  maintainability  study.  Information  concerning  their 
application  is  contained  in  Volume  II.  Details  concerning 
their  development  are  contained  in  Section  3  of  this  re¬ 
port  and  previous  contract  reports. 2, 3, 4) 
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3.  PHASE  V  PRCX3RAM 

3.1  General 

The  Maintainability  Technique  Study  begem  June  1959  after 
the  award  of  contract  A730 (602) -2057  to  the  RCA  Service 
Compemy.  The  preliminary  plan,  outlined  In  the  RCA 
Proposal  (30  OEP-29)  to  the  Rome  Air  Development  Center 
(RADC) ,  was  designed  as  a  five  phase  effort  responsive  to 
the  desired  RADC  objectives.  These  five  phases  are  listed 
as  follows: 

I  Design  of  the  Research  Plan 

II  Field  Data  Collection  and  Laboratory  Programs 

III  Reduction  and  Analysis  of  Data  to  Maintainability 
Indices 

IV  Development  of  Prediction  Technique 

V  Trial  Application  and  Validation 

Most  of  the  ground  rules  and  major  decisions  relative  to 
basic  approaches  were  initiated  In  the  first  and  second 
phases  of  the  program.  Ihe  results  of  the  first  four 
phases  of  this  program  have  been  documented  in  previously 
Issued  reports.  (1 .2,3,4)  fifth  and  final  phase  of 

this  program  is  described  in  the  following  paragraphs. 

3.2  Phase  V  Objectives 

The  final  phase  of  this  progreun  had  three  major  objectives: 

a.  Validation  of  the  maintalned^lllty  prediction 
technique 

b.  Validation  of  the  Electronic  Maintenance  Proficiency 
Test  (EMPT) 

c.  Refinement  of  other  techniques  developed  during 
the  program 
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Th«  validation  of  the  prediction  technique  waa  to  be 
accompllahed  by  coaqparing  predictions  made  on  equipaMmt« 
not  previously  evaluated,  with  data  obtained  from  field 
'»peratlon.  Thm  validity  of  the  BMPT  was  to  be  established 
"^^urouqh  the  comparison  of  scores  achieved  by  a  selected 
group  of  civilian  technicians  with  the  total  time  required 
for  each  technician  to  perform  a  group  of  representative 
maintenance  tasks.  Other  techniques  %#ere  refined  through 
further  analysis  of  the  data  bbtained  during  the  first 
four  phases  of  the  program  and  through  evaluation  of  other 
work  accomplished  in  the  field  of  maintainability. 

3.3  Maintainability  Prediction  Technique 

nie  prediction  technique  chosen  was  based  on  linear  re¬ 
gression.  Ihe  linear  regression  process  involves  finding 
a  relation  between  several  independent  variables  and  one 
dependent  variable.  In  this  case  time  was  the  dependmit 
variable  and  the  checklists  were  the  independent  variables. 
The  process  of  development  of  this  approach  is  described 
in  the  paragraphs  below. 

3.3.1  Beekaround  -  The  four  months  following  the  award  of 
the  contract  were  devoted  to  the  development  of  a  detailed 
research  plan.  This  effort  Involved  the  development  of  a 
technical  approach,  generation  of  data  collection  devices, 
selection  of  field  and  laboratory  equipments,  selection  of 
sites,  selection  and  training  of  observer  personnel,  and 
the  establishment  of  a  program  schedule. 

3.3. 1.1  Following  the  planning  stage,  a  field  study  program 
was  instituted  to  gather  data  on  the  maintenance  process. 
These  data  were  gathered  on  the  AN/OKA-5  data  link,  the 
AM/P8T-2  data  processor,  and  the  AN/FPS-20  search  radar  at 
eight  Air  Force  sites  in  tne  continental  United  States. 
Through  the  field  program,  corrective,  preventive,  and 
RK^ficatlon  tasks  were  monitored,  timed  and  scored.  In- 
formatl<»n  relative  to  environmental  conditions,  equipment 
background,  operating  conditions,  personnel  characteristics, 
and  the  support  situation  was  gathered  at  each  site  prior 

to  the  look  into  the  maintenance  activity  and  task  per¬ 
formances.  After  careful  screening  of  all  data  submitted 
by  the  field  observers,  a  total  of  101  corrective  maintenance 
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tasks  and  42  pravsntivs  mslntensncs  tasks  wars  found  suit- 
abis  for  usa. 

3. 3. 1.2  nta  naxt  stap  In  the  davalopawnt  of  the  pradlctlon 
taohnlqua  was  to  datarmina  tha  distributions  of  tna  para- 
natars  and  tha  relations  batwaan  than,  fha  distribution 

of  down  tins  was  found  to  be  log-nomal#  While  aaoh  design 
chaoklist  and  tha  total  of  the  suMort  chaoklista  ware 
normally  distributed.  A  correlation  analysis  parforbad 
batwaan  down  time  corrective  malntananoa  actions  only  and 
three  of  the  design  checklists  established  the  ohaokliwts 
as  tha  bast  predictors  of  down  tine,  this  analysis  is  des¬ 
cribed  in  detail  in  the  phase  IV  progress  report*  "Naln- 
talnid»illty  Prediction  Technique.* 

3. 3. It 3  The  final  step  was  to  develop  a  prediction  equation 
and  evolve  a  process  for  applying  it.  A  regression  analysis 
was  performed  between  the  selected  design  checklists  and 
active  corrective  maintenance  down  time.  Ihis  analysis 
resulted  in  the  following  prediction  equation! 

tog  -  3.54651  -  0.02512  A  -  0.03055  B  -  0.01093  C  (3.1) 

Ifheret 

Log  ■  Logarithm  of  corrective  active  down  time 

A  ■  Physical  design  factors  score 

B  Design  dictates  -  Facilities  score 

C  "  Design  dictates  -  Maintenance  skills  score 

A  procedure  was  then  developed  to  apply  this  equation  in  the 
evaluation  of  an  equipment  during  its  design  cycle.  This 
procedure  Is  described  in  detail  in  Section  5,  Volume  II, 
of  this  report. 

3.3.2  Trial  Prediction  -  The  first  step  in  the  validation 
of  the  maintainability  prediction  technique  was  to  perform 
an  analysis  of  two  equipments  not  previously  evaluated, 
using  data  normally  available  during  the  design  phase.  The 
AN/PPS-6  height-finder  radar  and  the  AN/ORT-3/ORR-7 
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dommunlcatlons  equlpnnents  were  selected  as  the  vehicles  for 
performing  the  validation.  Ihe  following  paragraphs  describe 
in  detail  the  application  of  the  prediction  technique  to 
each  of  these  equipments. 

3. 3. 2.1  AN/FPS-6  Radar  -  Ohe  equipment  is  an  alr-trans- 
portable,  high-power#  long-range  fixed-station#  height  finder 
for  use  in  association  with  a  search  radar  of  oouqparahle 
range  capability.  The  equipment  is  installed  with  its  an¬ 
tenna  and  radio  frequency  units  mounted  on  a  tower#  and  its 
control  and  indicating  units  installed  in  the  operrtlons 
building  of  the  associated  search  radar.  Ihe  equipuient  has 
an  average  coitplexlty  of  3150  parts  and  maintenance  is 
performed  on  the  part  basis.  Power  requirements  are  SO 
kilowatts  of  120/208volts#  3  phase  at  60  oyclea.  The  equip¬ 
ment  can  operate  in  temperate#  arctic#  ahd  tropical  climates. 

3. 3. 2. 1.1  Types  of  Predictions  -  Two  predictions  were  made 
for  the  AN/FPS-6  equipment  corresponding  to  the  following 
equipment  development  periods i 

a.  Ninety  days  after  award  of  contract  or  at  conqpletlon 
of  the  paper  design  of  the  contract  article. 

b.  Sixty  days  prior  to  delivery  of  the  contract 
article. 

The  prediction  made  at  the  stage  (a)  constitutes  a  preliminary 
estimate  based  on  limited  knowledge  of  circuit  configuration 
and  with  general  guidelines  for  the  packaging  concepts. 

Stage  (b)  was  a  prediction  which  makes  use  of  the  full  design 
information.  All  information  used  for  the  maintainability 
pre^ctlon  of  this  equi^ent  was  obtained  from  the  applicable 
Air  Force  Technical  Orders. 

3. 3. 2. 1.2  Preliminary  Prediction#.  AN/FP8-6  -  The  following 
detailed  information  was  used  to  accomplish  the  preliminary 
prediction: 


a.  Functional  block  diagram 

b.  Estimated  part  complexity  for  each  functional  block 
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c.  General  theory  of  operation 

d.  .  Exterior  views  of  all  major  assemblies 

e.  Description  of  general  construction  techniques  to 
be  used 

f.  Description  of  displays  and  controls  to  be  provided 

g.  Assumption  that  a  test  point  Is  available  at  the 
output  of  each  functional  block,  and 

h.  List  of  tools  and  test  equipment  avalledale. 

3. 3. 2. 1.3  After  familiarization  with  the  Information 
supplied,  the  first  step  was  to  predict  the  failure  rate  of 
each  functional  block.  This  was  accomplished  by  multiplying 
the  part  class  complexities  by  average  failure  rates  obtained 
from  field  data  for  radar  equipment.  A  sample  size  of  20 
was  selected  on  the  basis  of  909^  confidence  and  409^  accuracy 
and  this  sample  was  distributed  among  the  functional  blocks 
In  accordance  with  their  percentage  contribution  to  the 
equipment  failure  rate.  Table  3.1,  "AN/FPS>6  Functional 
Block  Failure  Distribution,"  shows  the  sample  selection. 

Part  types  for  failures  were  randomly  assigned  to  the 
selected  sample  In  accordance  with  the  following  distribution! 
15  electron  tubes,  2  resistors,  1  capacitor,  1  N-type  diode, 
and  1  relay.  (Past  reliability  history  of  similar  equipments 
Indicates  this  to  be  a  typical  breakdown  of  20  consecutive 
failures.)  For  each  part  a  typical  failure  mode  for  the 
particular  part  type  and  circuit  function  was  assumed  and 
the  symptoms  of  the  failure  were  determined.  A  maintenance 
analysis  was  performed  for  each  assumed  failure  and  from  this 
analysis  and  the  technical  Information  supplied,  the  design 
checklists  were  scored.  In  cases  where  there  was  In¬ 
sufficient  Information  to  score  a  particular  checklist  Item, 
the  Item  was  given  the  average  score  for  the  Items  In  the 
checklist  that  could  be  scored  for  that  particular  task. 

The  last  step  was  to  predict  the  down  time  for  each  task  by 
Inserting  the  checklist  scores  In  the  prediction  equation. 

The  data  derived  from  this  prediction  are  shown  In  Table  3.2, 
"AN/FPS-6  Preliminary  Prediction." 
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TABLE  3.2 
AM/FPS-6 

PRELIMIMARY  PREDICTION 


Circuit 

Part 

fvmctian 

Type 

1 

Mod. Trigger  Amp. 

Res. 

2 

Modulator  Control 

Tube 

3 

Power  8upply 

Relay 

4 

Mixer-Amplifier 

Tube 

5 

Power  8upply 

Tube 

6 

Range  Mk.  Oen. 

Tube 

7 

IF  Amp.  &  Detect. 

Tube 

8 

IF  Amp.  &  Detect. 

Tube 

9 

Inter fer . Blanker 

Tube 

10 

As.  8ervo  Amp. 

Tube 

11 

Horlz.8weep  Gen. 

Tube 

12 

8weep  Gate  Gen. 

Res. 

13 

Vert.  8weep  Gen. 

Tube 

14 

Ht.  Mk.  Gen. 

Tube 

15 

Video  Amplifier 

Tube 

16 

Power  8upply 

Tvdbe 

17 

Power  8upply 

Tube 

18 

Power  8upply 

Diode 

19 

Remote  Ht.Dlepl. 

Cap. 

20 

Remote  Ht.Dlepl. 

Tube 

Operation  A 

& 

8 

823.0 

494. 

as 

34,231.0 

12,236. 

SV20  33,866.45 

12,201.1 

8SD 

364.55 

34. 

(fj 

19.19 

1. 

(f 

4.38 

1. 

8 

41.15 

24. 

c 

0.11 

0. 

**»ax 

• 

• 

L 

£ 

£ 

5=1 

28 

23 

19 

1.93283 

85.7 

42 

26 

27 

1.40206 

25.2 

36 

24 

16 

1.73411 

54.2 

44 

26 

17 

1.46112 

28.9 

42 

25 

16 

1.55284 

35.7 

43 

25 

20 

1.48400 

30.5 

45 

25 

18 

1.45562 

28.6 

42 

23 

18 

1.59208 

39.1 

45 

25 

17 

1.46655 

29.3 

44 

21 

20 

1.58108 

38.1 

42 

26 

18 

1.50043 

31.7 

40 

25 

11 

1.65773 

45.5 

44 

25 

14 

1.52446 

33.5 

44 

25 

14 

1.52446 

33.5 

40 

23 

14 

1.68604 

48.5 

38 

26 

17 

1.61184 

40.9 

46 

26 

24 

1.33437 

21.6 

40 

24 

18 

1.61177 

40.9 

34 

25 

11 

1.80845 

64.3 

44 

26 

22 

1.40647 

25.5 

£ 

LogM^^ 

0 

351. 

0 

31.32831 

781.2 

0  6, 

455. 

0 

49.47638  34 

,882.80 

80  6, 

160. 

05 

49.07315  30 

,513.67 

20 

294. 

95 

0.40323  4 

,369.13 

80 

15. 

52 

0.02122 

229.95 

34 

3. 

94 

0.14568 

15.16 

70 

17. 

55 

1.56642 

39.06 

054 

0. 

22 

0.093 

.39 

- 

2.34963 — > 

223.7 
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3. 3.2. 1.4  From  the  data  derived  In  the  above  prediction 
maintainability  Indices  were  calculated.  The  mean  down  time 
was  calculated  ^  dividing  the  total  down  time  (781.2  minutes) 
by  the  sample  size  (20)  to  obtain  39.1  minutes.  The 
maximum  down  time  (>L.„)  was  calculated  using  the  following 
equationi 


*W  !•=  «et 


(3.2) 


Where t 


log  ■  mean  of  the  log  down  times 

Using  the  data  from  Table  3.2  a  value  of  223.7  minutes  was 
computed. 


3. 3. 2. 1.5  Full  Design  Prediction.  AM/FPS-6  -  nie  full  design 
prediction  was  accomplished  using  the  complete  information 
available  from  the  equipment  technical  orders.  Ttim  first 
step  was  to  make  a  part  coxint  from  the  Illustrated  Farts 
Breakdown  (T.O.  31P3-2FPS6-4)  to  determine  equipment  com¬ 
plexity  by  part  class.  From  this  the  total  failure  rate 
for  each  part  class  was  determined,  using  average  rates  from 
reliability  field  data.  A  sample  size  of  50  was  selected 
on  the  basis  of  9096  confidence  and  2596  accuracy.  The  per¬ 
cent  contribution  of  part  class  failure  rates  to  equipment 
failure  rate  was  used  to  determine  the  distribution  of  part 
types  In  the  sample  of  50.  Table  3.3, "AN/FPS-6  Failure 
Distribution,”  shows  the  failure  rate  cosqputatlon  and  the 
sample  selected.  The  next  step  was  to  select,  randcxnly, 
the  sample  parts  from  the  total  equipment  population. 

This  was  accomplished  with  the  aid  of  a  table  of  random 
numbers.  After  the  seuaple  was  selected  a  typical  failure 
mode  was  assumed  for  each  part  and  the  symptoms  of  equip¬ 
ment  failure  determined.  A  maintenance  analysis  was  per¬ 
formed  for  each  sample  part  and  the  design  checklists  scored, 
using  the  maintenance  analysis  and  the  information  available 
from  the  technical  orders.  The  final  step  was  to  Insert  the 
checklist  scores  In  the  prediction  equation  for  each  task 
and  compute  the  expected  down  time.  The  data  derived  from 
this  prediction  are  shown  in  Table  3.4,  "AN/FPS-6  Main¬ 
tainability  Prediction." 
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TABLE  3.4 
AN/PPS-6 

MAINTAINABILITY  PREDICTION 


Major 


Checklist 


Task 

Unit 

Ass  V. 

Part 

A 

£ 

£ 

1 

OA-270 

lP-188 

V-4008 

38 

25 

21 

1.59867 

39.7 

2 

OA-270 

PP-795 

V-4102 

36 

25 

19 

1.67077 

46.9 

3 

OA-270 

PP-795 

V-4104 

40 

25 

18 

1.58122 

38.1 

4 

OA-270 

PP-795 

V-4106 

36 

23 

13 

1.79745 

62.7 

5 

OA-270 

PP-795 

V-4110 

46 

26 

16 

1.42181 

26.4 

6 

OA-270 

PP-795 

V-4111 

46 

26 

21 

1.36717 

23.3 

7 

OA-270 

PP-795 

R-4110 

32 

23 

11 

1.91979 

83.1 

8 

OA-270 

PP-828 

CR-4151 

25 

23 

11 

2.09563 

124.6 

9 

OA-270 

IP-188 

V-4306 

41 

23 

7 

1.73743 

54.6 

10 

OA-270 

IP-188 

V-4402 

43 

23 

16 

1.58882 

38.8 

11 

OA-270 

IP-188 

V-4403 

41 

23 

11 

1.69371 

49.4 

12 

OA-270 

IP-188 

V-4407 

41 

23 

16 

1.63906 

43.6 

13 

OA-270 

lP-188 

V-4604 

41 

25 

19 

1.54517 

35.1 

14 

OA-270 

IP-188 

V-4701 

41 

23 

14 

1.66092 

45.8 

15 

OA-270 

lP-188 

V-4703 

41 

23 

13 

1.67185 

47.0 

16 

OA-270 

lP-188 

V-4802 

48 

26 

23 

1.29506 

19.7 

17 

OA-270 

IP-188 

V-4805 

42 

23 

17 

1.60301 

40.1 

18 

OA-270 

IP-188 

V-4903 

43 

25 

18 

1.50536 

32.1 

19 

OA-320 

TS-735 

V-5210 

37 

21 

12 

1.84436 

69.9 

20 

OA-320 

TS-735 

V-5213 

37 

21 

16 

1.80064 

63.2 

21 

OA-320 

MX-1316 

V-5503 

41 

23 

18 

1.61720 

41.4 

22 

OA-320 

MX-1316 

V-5504 

41 

23i 

16 

1.63906 

43.6 

23 

OA-320 

MX-1316 

V-5506 

39 

23 

20 

1.64558 

44.2 

24 

OA-320 

AM-646 

V-6003 

32 

19 

11 

2.04199 

110.2 

25 

OA-320 

AM-646 

V-6006 

30 

23 

17 

1.90445 

80.3 

26 

OA-320 

AM-622 

V-21705 

41 

21 

18 

1.67830 

47.7 

27 

OA-320 

AM-622 

V-21714 

36 

25 

18 

1.68170 

48.1 

28 

OA-320 

MX-1359 

T-5601 

30 

17 

11 

2.15333 

142.3 

29 

OA-357 

PP-755 

V-1104 

39 

25 

21 

1.57355 

37.5 

30 

OA-357 

PP-755 

K-1101 

40 

24 

23 

1.55712 

36.1 

31 

OA-357 

PP-755 

V-1110 

37 

26 

16 

1.64789 

44.5 

32 

OA-357 

PP-755 

V-1112 

39 

25 

22 

1.56262 

36.5 

33 

OA-357 

0-166 

V-21303 

31 

19 

9 

2.08897 

125.6 

34 

OA-357 

0-166 

R-21304 

26 

18 

8 

2.25605 

180.3 

35 

OA-357 

CV-218 

V-21505 

37 

23 

16 

1.73954 

54.9 

36 

OA-357 

CV-218 

V-21506 

37 

23 

18 

1.71768 

52.2 

1 


1 
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TABLE  3.4  (CONT.) 


Taak 

Major 
Vni.t  ■ 

6§9'yt 

Part 

A 

B. 

£ 

Log  M^^ 

37 

OA-357 

CV-218 

CR-21501 

35 

24 

18 

1.73737 

54.6 

38 

OA-329 

AM-654 

V-2004 

30 

15 

7 

2.25815 

181.2 

39 

QA>329 

CM-187 

CR-2101 

36 

19 

11 

1.94151 

87.4 

40 

OA>329 

CM-187 

CR-2102 

18 

12 

7 

2.65124 

448.0 

41 

OA--329 

cy-1138 

S-2204 

41 

25 

25 

1.47959 

30.2 

42 

PP-783 

PP-793 

V-10402 

39 

23 

13 

1.72209 

52.7 

43 

C>1048 

C-1048 

B-3901 

34 

23 

23 

1.73839 

54.8 

44 

CM-93 

CH-93 

J-10303 

28 

23 

16 

1.96562 

92.4 

45 

J-470 

J-470 

K-9710 

38 

26 

24 

1.53533 

34.3 

46 

PU-292 

PU-293 

Z-3507 

28 

23 

.16 

1.96562 

92.4 

47 

10-331 

ID-331 

V-3701 

43 

23 

17 

1.57789 

37.8 

48 

ID-331 

ID-331 

V-3703 

44 

23 

18 

1.54184 

34.8 

49 

10-331 

10-331 

V-3704 

42 

23 

17 

1.60301 

40.1 

50 

C-1049 

C-1049 

V-3802 

52 

26 

31 

1.10714 

12.8 

Operation 

L  h 

B  £ 

Log  M^^. 

JCl 

S 

1,879.0 

1,140.0  817.0 

86.36821 

3,363.0 

SS 

72,454.0 

26,388.0  14,595.0 

152.66015 

441,659.16 

sVso 

70,612.82 

25,992.0  13,349.78 

149.18935 

226,195.38 

SSO 

1,932.18 

396.0  1,254.22 

3.47080 

215,463.78 

(13 

39.43 

8.08  25.41 

0.07083 

4,397.22 

CT 

6.28 

2.84  5.04 

0.26614 

66.31 

s 

37.58 

22.80  16.34 

1.72736 

67.26 

c 

0.17 

0.12  0.31 

0.15 

0.99 

**max 

- 

—  — 

2.59104- 

■ - >390.0 
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3.3.2. 1.6  The  data  from  the  full  design  prediction  waa  uaed 
to  compute  the  mean  down  time  and  the  maximum  down  time, 
nie  mean  down  time  le  emal  to  the  total  down  time  divided 
by  50  (sample  else)  or  67.3  minutes.  The  maximum  down  time, 
computed  the  use  of  equation  (3.2),  was  found  to  bo 
390.0  minutes. 

3. 3.2. 2  ^flMra/gRR-7  ComuniCttttflQI.  -  Die 

AM/aiUl-7  is  a  single  channel  ground  UBT  receiver  which  covers 
the  frequency  range  fron  225  to  399.9  me.  It  can  be  used 
for  reception  of  either  voice  or  tone  aiig>litude  modulated 
signals.  The  equipment  has  an  average  cosqplexity  of  325 
parts  and  maintenance  la  performed  at  the  part  level.  Power 
requirements  are  140  watts  of  115  or  230  volts  single  phase 
at  50  to  60  cycles.  The  equipment  will  operate  satisfactorily 
at  temperatures  ranging  from  -20OF.  to  ■fl31^F. 

3. 3. 2. 2.1  The  AN/GRT-3  is  a  single  channel  ground  UHF 
transmitter,  Which  covers  the  frequency  range  from  225  to 
399.9  me.  When  used  in  conjunction  with  receiver  Air/OlUl-7 
the  equipment  Is  capable  of  establishing  two  way  radio 
communication  with  aricraft  or  other  ground  communication 
radio  sets.  The  equipment  has  an  average  complexity  of 
315  parts  and  maintenance  is  performed  at  the  part  level. 

Power  requirements  are  1250  watts  of  115  or  230  volts  at  50 
to  60  cycles.  It  will  operate  satisfactorily  at  temperatures 
ranging  from  -209F.  to  +1310F. 

3. 3. 2. 2. 2  Full  Design  Prediction  -  AH/ORT-3/GRR-7  -  Only 
a  full  design  prediction  was  made  for  the  communications 
equipment.  The  information  on  which  the  prediction  is 
based  was  obtained  from  the  Air  Force  technical  orders 
published  for  this  equipment.  The  steps  taken  in  making  the 
prediction  are  the  same  as  those  for  the  AN/FPS-6  full  design 
prediction.  The  results  of  apportioning  the  sample  to  the 
part  classes  are  shown  in  Table  3.5,  ''AM/ORR-7/GRT~3  Failure 
Distribution."  It  should  be  noted  that  with  this  equipment 
the  electron  tube  class  was  divided  into  receiving  and 
transmitting  types  because  of  the  difference  in  their 
failure  rates.  The  data  derived  from  the  prediction  are 
shown  in  Table  3.6,  "AH/GRR-7/GRT-3  Maintainability  Pre¬ 
diction." 
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TABLE  3.6 

AN/GRR-7/QRT-3 
Maintainability  Prediction 


Unit 

Part 

L 

S. 

S. 

^”ct 

T-282 

C618 

18 

22 

17 

2.23644 

172.4 

MD-141 

KlOl 

44 

26 

20 

1.42833 

26.8 

MO-141 

T102 

24 

22 

16 

2.09665 

124.9 

MD-141 

VlOl 

40 

22 

20 

1.65101 

44.8 

MD.-141 

V102 

40 

22 

20 

1.65101 

44.8 

MD-141 

V102 

40 

22 

20 

1.65101 

44.8 

MD-141 

V103 

40 

22 

20 

1.65101 

44.8 

MD-141 

V103 

40 

22 

20 

1.65101 

44.8 

MD-141 

V104 

40 

22 

20 

1.65101 

44.8 

MD-141 

V103 

40 

22 

20 

1.65101 

44.8 

MD-141 

V105 

42 

26 

20 

1.47857 

30.1 

T-282 

Z901 

26 

22 

16 

2.04641 

111.3 

T-2a2 

V901 

36 

28 

21 

1.55726 

36.8 

T-2G2 

V902 

36 

28 

21 

1.55726 

36.8 

T-282 

V902 

36 

28 

21 

1.55726 

36.8 

T-282 

V902 

36 

28 

21 

1.55726 

36.8 

T-282 

V903 

36 

28 

21 

1.55726 

36.8 

T-282 

V903 

38 

28 

21 

1.50702 

32.1 

T-282 

V601 

42 

26 

21 

1.46764 

29.4 

T-282 

V602 

42 

26 

21 

1.46764 

29.4 

T-282 

V602 

42 

26 

21 

1.46764 

29.4 

T-282 

V602 

42 

26 

21 

1.46764 

29.4 

T-282 

V603 

42 

26 

21 

1.46764 

29.4 

T-282 

V604 

40 

26 

21 

1.51788 

33.0 

T-282 

V703 

48 

28 

21 

1.25582 

18.0 

T-282 

V705 

48 

28 

21 

1.25582 

18.0 

T-282 

V706 

48 

28 

21 

1.25582 

18.0 

T-282 

V706 

48 

28 

21 

1.25582 

18.0 

MD-141 

V301 

40 

26 

20 

1.52881 

33.8 

MD-141 

V301 

40 

26 

20 

1.52881 

33.8 

MD-141 

V201 

38 

28 

20 

1.51795 

33.0 

MD-141 

V202 

38 

28 

20 

1.51795 

33.0 

MD-141 

V203 

48 

24 

21 

1.37802 

23.9 

R-361 

L307 

28 

21 

16 

2.02672 

106.4 

R-361 

R330 

32 

21 

15 

1.93717 

86.5 

R-361 

V303 

34 

23 

19 

1.78211 

60.6 

R-361 

V304 

54 

28 

28 

1.02859 

10.7 

26 


TABLE  3.6 


Task 

Unit 

Part 

h 

38 

R-361 

V304 

39 

39 

R-361 

V306 

44 

40 

R-361 

V310 

34 

41 

R-361 

V311 

28 

42 

R-361 

V401 

26 

43 

R-361 

V402 

26 

44 

R-361 

V404 

26 

45 

R-361 

V501 

35 

46 

R-361 

V502 

35 

47 

R-361 

V503 

53 

48 

R-361 

V504 

35 

49 

R-361 

V505 

36 

QpfigtttiQn 

h 

£ 

s 

1,863.0 

1,206.0 

88 

73,513.0 

30,068.0 

8^/49 

70,832.02 

29,682.37 

88D 

2,680.98 

385.63 

55.85 

8.03 

d 

7.47 

2.83 

§ 

38.02 

24.61 

c 

0.20 

0.11 

**taax 

— 

• 

(CONT. ) 


£ 

£ 

Log 

l!Et 

25 

26 

1.51890 

33.0 

28 

25 

1.31238 

20.5 

21 

18 

1.85414 

71.5 

26 

18 

1.85211 

71.1 

21 

16 

2.07696 

119.4 

21 

16 

2.07696 

119.4 

21 

16 

2.07696 

119.4 

21 

17 

1.83995 

69.2 

21 

17 

1.83995 

69.2 

26 

26 

1.13667 

13.7 

21 

17 

1.83995 

69.2 

21 

18 

1.80390 

63.7 

£ 

974.0 

79.49131 

2,508.2 

19,708.0 

132.48869 

188,572.64 

19,360.73 

128.95649 

128,389.13 

347.27 

3.53220 

60,183.51 

7.23 

0.07358 

1,253.82 

2.69 

0.27126 

35.41 

19.88 

1.62227 

51.19 

0.14 

.17 

^  .69 

- 

2.43341  — 

271.3 
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1.3. 2. 2. 3  Maintainability  indices  were  calculated  for  the 
communications  equipment  from  the  total  of  the  predicted 
down  times.  The  mean  down  time  value  was  51.2  minutes  while 
the  maximum  down  time  value  watf  271.3  minutes. 

3.3.3  Field  Study  -  Simultaneous  with  the  predictions  of 
maintainability  a  program  was  instituted  to  dbserve  the  actual 
maintenance  performed  on  the  selected  equipments  at  field 
locations.  Observers  were  trained  to  monitor  maintenance 
actions  I  and  to  gather  associated  information*  Upon 
completion  of  their  training  they  were  assigned  to  Air  Force 
sites  at  Benton  AF8,  Pennsylvania  and  Lockport  AFS,  Haw  York. 
At  these  locations  the  observers  recorded  down  times  for 
actual  maintenance  tasks  and  developed  checklist  scores  for 
each  of  these  tasks.  In  addition  they  gathered  data  con¬ 
cerning  the  personnel  emd  support  parameters. 

3. 3. 3.1  Data  Yield  -  A  total  of  43  and  23  corrective  main¬ 
tenance  tasks  were  recorded  for  the  AH/QRR-7/ORT-3  and  the 
AM/FPS-6  equipments  respectively.  Through  screening  to 
remove  ambiguous  data,  these  totals  were  reduced  to  40  and 
22  respectively.  At  the  start  of  the  collection  period  two 
operational  AM/FPS-6  equipments  were  located  at  each  site. 
Midway  in  the  collection  program,  one  AN/FPS-6  at  each  site 
was  removed  and  replaced  with  the  AM/FPS-26.  Additionally, 
at  the  Lockport  site  difficulty  with  the  primary  power 
circuits  curtailed  operation  for  an  extended  period.  These 
occurrances  reduced  considerably  the  potential  data  yield. 

Data  secured  for  the  AM/GRR-7/GRT-3  generally  approached  the 
desired  level.  Although  the  overall  data  yield  for  the 
equipments  was  lower  them  expected,  the  sample  sizes  were 
considered  sufficient  to  make  significant  comparisons  with 
the  previously  predicted  values. 

3.3.4  Validation  Analysis  -  A  detailed  analysis  of  the  field 
data  was  made  and  comparisons  with  the  predicted  values 
accomplished.  The  specific  points  of  comparison  were  the 
mean  and  Mmax*  Prediction  equations  for  the  Individual 
equipments  were  obtained  and  the  results  compared  to  those 
obtained  by  the  original  prediction  equation  (3.1). 

3. 3. 4.1  Data  -  Table  I-l,  "Field  Data,”  (Appendix  I)  pre¬ 
sents  the  basic  data  derived  from  the  experiment  both  for 
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corrective  and  preventive  maintenance.  Table  1-2,  "Field 
Data  -  Phase  5  Maintainability  Study,"  (Appendix  I)  pre¬ 
sents  the  data  utilised  for  purposes  of  this  analysis. 
Logarithm  of  the  maintenance  time  were  taken  and  checklists 
A,  B,  and  C  for  corrective  maintenance  only  were  used. 

(For  convenience  In  handling  the  data,  each  of  the  check¬ 
lists  was  divided  by  100.)  Table  1-3,  "Sum  of  Squares, 
Products,  etc.,"  (Appendix  I)  sets  up  the  data  Into  a  form 
suitable  for  regression  analysis  and  calculation  of  slnqple 
correlation  coefficients.  (See  Volume  2,  Appmidlx  II, 
"Mathematical  Formulas.")  nie  means,  variances,  standard 
deviations,  and  coefficient  of  variation  also  were 
calculated  as  part  of  Table  1-3. 

3. 3. 4. 2  Tlitl.Xgl,  HamalitY  -  Bacl*  of  the  checklists  A,  B, 

C,  and  Z  (Z  log  Met)  tested  for  goodness  of  fit  to 
the  normal  distribution,  by  the  Kolmogarov-Smlrnov  (d) 
test,  at  the  59(  level.  (See  Volume  2,  Appendix  II.) 

The  null  hypothosls  wast  "niere  Is  no  difference  between 
the  distribution  of  the  real  data  and  the  normal  distribution 
formed  by  estimating  the  mean  and  the  variance  of  the  data." 
The  test  values  (d)  are  contained  in  the  following  tablet 


Bqyjpmfflt 

JH- 

Ili^  YAlMfff  id) 

AN/FPS-6 

22 

0.2819 

AM/QRT-3/aRR-7 

40 

0.2101 

Total 

62 

0.1698 

The  null  hypothesis  was  upheld  In  each  case  tested. 

3. 3. 4. 3  Sample  Validity  -  It  was  necessary  before  pro¬ 
ceeding  with  the  analysis  to  establish  whether  or  not  the 
new  time  data  were  estimates  of  the  szune  population  as  the 
orginal  data  used  In  phase  four  of  the  stud^.  The  table 
below  presents  the  data  utilized  in  this  comparison: 


Data  N 

Original  101 

Total  New  62 


I  ^  S. 

1.64051  0.21632  0.46510 

1.70446  0.17512  0.41847 
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Since  both  sets  of  data  were  log  normally  distributed  it 
was  decided  to  apply  parametric  tests;  l.e.,  th#  £  test 
for  similarity  of  variances  and  the  ^  test  for  difference 
of  means. 


L 

Jl 


O'?  /<r? 


cTp  VVKi  +  V»2 


df 


df 


Where i 


(N^-1)  +  (N 


(H^-l),  (Hj-l) 
»1  +  -  2 


(3.3) 

(3.4) 

(3.5) 


The  £.  test  yielded  a  value  1.24  and  the  ^  test  a  value 
-0.885  both  of  which  were  insignificant  at  the  5%  level. 

So  the  statement  could  be  made  that  the  two  sets  of  data 
were  estimates  of  the  same  population. 

3. 3. 4. 3  New  Data  Predicted  bv  Nomograph  -  A  check  on  the 
reliability  of  the  on-site  monitors  was  provided  by  pre¬ 
dicting  the  down  time  from  the  checklists.  Figure  3.1, 

"New  Data  Predicted  by  Nomograph,"  presents  the  results  of 
this  check.  The  diagonal  lines  represent  plus  or  minus 
two  steuidard  errors.  It  can  be  seen  that  all  of  the  points 
lie  inside  these  two  standards. 

3. 3. 4. 3.1  Multiple  Correlation  Coefficients  -  A  further 
check  is  provided  by  inspection  of  the  multiple  correlation 
coefficients.  Let  the  log  values  determined  with  the  aid 
of  the  nomograph  be  represented  Z'  and  the  actual  log  values 
be  Z;  then  the  multiple  correlation  coefficients  are  as 
follows: 

Radar  r^’  -  0.941  (N  -  22) 


Predicted  Timers  (Hin. 
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FIGURE  3.1.  NEW  DATA  -  PREDICTED  BY  NOMOGRAPH 
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Comm.  Eq. 

(N  -  40) 

Total 

r^^'  “  0.937 

(M  -  62) 

The  null  hypothesis  wast  “That  the  two  samples  are  not 
correlated."  It  can  be  readily  seen  that  the  null  hypothesis 
Is  disproved  and  that,  In  fact,  Z  and  Z*  are  highly 
correlated. 

3. 3. 4. 4  Prediction  vs.  Data 
The  predicted  arithmetic  meant 


N 

-  S  M 
1-1 


ct-l' 


(3.6) 


and  the  predicted  maximum  downtime! 


\ax-p  "  ^^ct 

were  compared  to  the  actual  data  for  the  arithmetic  meant 


«ct-d-Ji  "ct-iA 
and  (95th  percentile)  t 

<^109  <5-«> 

The  paragraphs  following  make  these  comparisons. 

3. 3.4. 5  Means  -  The  null  hypothesis  wast  "niere  Is  no 
difference  between  the  means  of  the  two  samples."  The 
significance  level  selected  was  5%  (two  tall  test.) 

The  statistic  chosen  was  equation  (3.4)  above.  Table  3.7, 
"Comparison  of  Means,"  sums  all  the  pertinent  data  leading 
to  a  value  of  the  chosen  statistic,  and  Indicates 
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Mfhether  or  not  waa  algnlf leant. 

3. 3. 4. 5.1  AN/FPS-6  Full  Dealon  Pradlctlon  -  Tha  mean  of  tha 

full  daalgn  pradlctlon  waa  varlflad  by  tha  actual  data  maan. 
Tha  actual  tablad  valua  of  waa  2.00.  Ihla  valua  would 
maan  that  a  dlffaranca  In  maana  of  34.32  mlnutaa  irould  juat 
be  algnlflcanti  and  tha  actual  dlffaranca  la  26.77  mlnutaa 
(Jt  "  1.56.)  The  actual  dlffaranca  26.77  mlnutaa  la  28.4% 
of  tha  obaarvad  value  of  94.03  mlnutaa  and  very  cloaa  to 
the  accuracy  figure  of  25%  that  waa  aaaumad  whan  thla  pre¬ 
diction  waa  begun  (N  ■  50,  ■  1.07.)  (4) 

3.3.4. 5.2  AW/FPS-6,  Preliminary  Dealon  Pradlctlon  -  Table 
3.7  raveala  that  the  preliminary  dealgn  pradlctlon  waa  not 
verified  by  the  actual  data.  Normally  Vlth  a  aampla  of  20 
an  accuracy  of  40%  could  be  expected  but  the  precUctlon 
waa  off  by  approximately  60%  from  the  actual  data.  The 

^  value  waa  3.49  aa  oppoaed  to  a  tabulated  value  of  2.02. 
There  were  two  major  cauaea  for  the  dlacrepancyt 

a.  The  predictor  In  hla  preliminary  prediction  haa  to 
to  aaaume  either  of  two  condltlona. 

(1)  The  malntained>lllty  will  be  controlled  (See 
Section  3,  Volume  II.) 

(2)  That  maintainability  la  not  controlled. 

Having  made  hla  choice  the  predictor,  guided  by 
hla  aaaumptlon,  evaluatea  the  dealgn  checkllata. 

The  predictor  in  thla  caae  aaaumed  condition  (1) 
on  a  piece  of  equipment,  the  AN/FPS-6,  that  waa 
not  aubject  to  maintainability  control;  but  could 
not  aaaume  otherwlae  and  atlll  maintain  hla 
objectivity. 

b.  It  haa  been  found  that  a  aample  alze  of  20  la 

not  large  enough.  Hie  aample  alze  ahould  be  30  or 
greater. 

3.3.4. 5.3  Comparison  of  the  Two  AN/FPS-6  Predlctlona  - 
The  meana  of  the  two  predlctlona  were  compared  with  the 
reaulta  ahown  In  Table  3.7.  This  queatlon  became  of 


COMPARISON  OF  MEANS 
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interest  when  the  results  showed  that  the  preliminary  pre¬ 
diction  did  not  match  the  actual  data  while  the  full  design 
prediction  did.  n\e  tabled  value  is  2.00  versus  a 
calculated  ^  value  1.87.  The  value  of  the  difference 
would  be  30.08  minutes  for  5%  significance  while  the  actual 
difference  la  28.20  minutes.  The  probable  significant 
difference  of  means  reflects  the  fact  that  one  person  per¬ 
formed  the  preliminary  prediction  and  another  the  full 
prediction.  The  one  performing  the  preliminary  prediction 
had  to  assume  condition  (1) ,  above,  concerning  the  various 
maintenance  problems,  for  lack  of  specific  information  to 
the  contrary.  The  other  was  aware  of  the  true  malnteneuice 
situation  and  could  assume  condition  (2). 

3. 3. 4. 5. 4  AW/GRT-3/QRR-7  -  Full  Design . Prediction  -  The 
mean  of  the  full  design  prediction  was  verified  by  the 
actual  data  mean.  The  tabled  value  of  was  1.99,  this 
value  corresponding  to  a  difference  in  means  of  19.78 
minutes.  The  actual  difference  was  12.12  minutes  which  was 
19.1?6  of  the  actual  data  and  well  within  the  accuracy 
figure  of  25%, 

3. 3. 4. 6  Maximum  Down  Time  -  The  null  hypothesis  used 
was:  "There  was  no  difference  between  the  predicted 
maximum  down  time  (I^ax)  tha  actual  Nmax  obtained 
from  the  data."  (Mmax  is  defined  for  each  case  in  para¬ 
graph  3. 3. 4. 4.)  ^e  statistic  chosen  was  the  standard 
error  of  the  95th  percentile.  The  basic  formula  for  this 
standard  error  is  as  follows:  (1^) 


S.E. ^  ggj 


2.11 


(f 

VT 


(3.10) 


it  follows  that  the  stauidard  error  of  the  difference  of  the 
log  values  of  is  given  by  the  following: 


S.E. 


(3.11) 


The  test  criteria  were:  if  the  difference  exceeded  2  S.E 
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It  was  probably  significant  and  If  It  exceeded  3  S.E.  It 
was  definitely  significant.  Table  3.8,  "Comparison  of  Log 
M.  , "  sums  all  the  pertinent  data  leading  to  values  of  the 
standard  error  and  Indicates  none  of  the  values  were  signi¬ 
ficant.  Three  comments  about  the  test  followt 

a.  The  approximation  sign  Is  used  In  .equation  (3.10) 
above  because  the  formula  for  standard  error 
assumes  a  large  sample.  It  Is  estimated  that 
the  maximum  error  In  making  this  assumption  for 

a  small  sample  (20  ::  M  100)  Is  5%. 

b.  It  Is  necessary  to  use  the  log  normal  distribution 
In  making  the  test  because  the  test  assumes 
normality. 

c.  The  test  Is  essentially  one  sided.  That  is,  it  Is 
of  no  concern  If  the  predicted  Mmny  Is  greater 
than  the  actual  data  Mm«v>  e.g.  A^GRT-3/GRR-7 . 

The  problem  lies  In  the  actual  data  Mm»v  beln^ 
greater  than  the  predicted  value;  e.g.  AN/FPS-6; 

3. 3. 4. 7  Distribution  of  Down  Time  -  Figure  3.2,  "Distri¬ 
bution  of  Down  Time  -  AN/FPS-6,"  and  Figure  3.3,  "Distri¬ 
bution  of  Down  Time  -  AN/GRT-3/GRR-7 , "  shows  the  predicted 
values  of  down  time  versus  those  actually  observed.  A 
relatively  powerful  non-parametrlc  statistical  test, 
"Mann-Whltney ,  U  Test,"  confirms.  In  each  of  the  cases, 
that  the  predicted  and  the  observed  are  drawn  from  the  seune 
population.  (The  preliminary  design  prediction  on  the 
AN/FPS-6  has  not  been  shown  because  It  was  demonstrated 
that  It  was  Invalid  In  preceding  sections.)  It  has  been 
shown  that  for  greater  than  20  [n^  (Observed) ,  N2 
(Predicted) ]  the  sampling  distribution  of  the  test  statistic 
U  Is  that  of  normal  distribution  with: 


X  -  (Nj^  N2)/2 


and 


N,  N2  (N^  N2  -  1) 

O  “  12 


(3.12) 

(3.13) 


37 


ility  of  CanpletloD  Within  Tine  t  (%) 
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Down  Time  t  (Min.) 

FIGURE  3.3.  DISTRIBUTION  OF  DOWN  TIME-AN/GRT-3/ORR-7 
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with  the 


test  atatlstlc  observed  in  Z  values  as  follows t 


(11) 


Z 


(T 


(3.14) 


Ihe  cases  cited  above  Z  equals  -1.70  for  the  AH/FPS-6 
and  Z  equals  -0.29  for  the  AN/ORT-3/ORR-7 ;  Inside  the  5% 
tabled  value  of  ±  1.96.  The  computation  of  U  Involves 
ranking  of  both  sets  of  data  Intermingled*  adding  the  ranks 
of  the  smaller  of  the  two  Pi*9«a  of  data  and  obtaining  a 
value  which  Is  called  R. ,  111)  then  applying  the  formula 
as  follows: 

N,  (N,  +  1) 

U  -  - 15 -  -  Rj^  (3.15) 


For  a  further  explanation  of  the  Mann-Hhltney  Test  see 
Appendix  II,  Volume  II. 


3. 3. 4. 8  Internal  Consistency  -  Internal  conalstency  means 
how  the  checklist  scores  compare  with  the  time  date  (log 
transform)  when  a  regression  equation  Is  formed  for  each 
of  the  new  equipments.  Ihe  date  used  for  forming  the  equa¬ 
tion  were  the  22  tasks  on  the  AN/FPS-6  and  the  40  tasks 
on  the  AN/ORR-7/GRT-3 .  Ihe  purpose  In  doing  this  Is  to 
check  Internally  the  relative  magnitude  of  the  constants 
and  multipliers  of  the  new  equations  compared  to  that  of 
the  equation  on  which  the  prediction  was  based  (Equation  3.1). 


3. 3. 4. 8.1  AN/FPS-6  -  Ihe  simple  correlation  coefficients 


were  as  listed  below: 

h. 

h  1 

B  N  »  22 

df  »  20 

£  5%  =  0.423 

Z 


B 

C 

Z 

0.663 

0.790 

-0.925 

1 

0.549 

-0.692 

1 

-0.858 

1 


40 


All  of  the  coefflclenta  were  significant  to  the  5%  level. 

3. 3. 4. 8. 2  When  the  correlation  coefficients  were  analyzed 
by  partial  correlation  techniques  the  results  were  as 
shown  below:  (For  a  summary  of  the  technique  used  see 
Appendix  2,  Volume  2,  this  report.) 


&  A  £  £ 

h 
& 

£ 

£ 


TWO  of  these  coefficients  were  significant  to  the  5%  level. 
These  were  AZ  and  CZ.  Checklist  A  -  Design  Factors,  was 
again  Independent  of  the  other  two  checklists  B  and  C.  (4) 
Likewise  B  and  C  were  Independent  of  each  other.  Even 
though  B  was  not  significantly  correlated  with  log  time 
it  was  decided,  in  the  Interests  of  uniformity,  to  develop 
a  regression  equation  using  all  three  checklists  (A,  B,  and 
C)  and  log  time  (Z) . 


— 

0*076 

-0.007 

-0.722 

N 

m  22 

-0.125 

-0.303 

df 

-  18 

5% 

-  0.444 

- 

-0.553 

3. 3. 4. 8. 3  The  regression  equation  developed  was: 

Z-  -  log  M  .  _  -  3.18691  -  0.02320  A  -  0.01349  B 
“  -  0.02120  C  (3.16) 


with  a  multiple  correlation  coefficient  of: 
0.953 


and  a  standard  error  of: 

0.17208  log  minutes 

The  regression  coefficients  of  A  and  C  were  tested,  by  the 
JH,  test,  at  the  5%  level  and  were  significant;  that  of  B  was 
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significant  at  the  10%  level.  Figure  3.4,  "Radar  Data  - 
Observed  vs.  Predicted,"  shows  the  Individual  task  time, 
nie  outer  pair  of  diagonal  lines  represents  two  standard 
errors  from  the  old  data  used  to  develop  the  nomograph. 
The  Inner  pair  represents  two  standard  errors  which  bound 
only  the  new  equation. 

3. 3. 4. 8. 4  AN./GRR-7/GRT-3  -  Using  the  same  analysis  pro¬ 
cedure  as  in  paragraph  3. 3. 4. 6.1,  the  simple  correlation 
coefficients  were  as  listed  belowt 


A 

a. 

£ 

£ 

1 

0.382 

0.616 

-.812 

& 

s. 

N  «  40 
df  -  38 

5%  -  0.312 

1 

0.564 

1 

-.703 

-.850 

s. 

1 

All  of 
level , 

the  coefficients  again  were  significant  at 

the  5% 

3. 3. 4. 8. 5  Partial  correlation  techniques 
following  results 1 

yielded 

the 

A 

& 

£ 

£ 

A 

- 

-0.533 

-0.372 

-0.809 

& 

S. 

em 

N  -  40 
df  -  36 

5%  -  0.320 

-0.271 

-0.687 

-0.724 

& 


The  Intercorrelations  are  svi^ch  that  a  procedure  similar  to 
Section  2.3.2,  "Comparison  of  Deviations,"  In  the  Phase  4 
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report,  had  to  be  adopted;  l.e.  by  testing  the  comparative 
predictive  power  for  various  combinations  of  A,  B,  and  C. 

The  combination  A,  B,  and  C  had  least  residue  (0.07013), 
was  the  best  predictor  and,  more  importantly,  was  signifi> 
cantly  better  than  any  other  combination  or  single  varisjale 
when  used  as  a  predictor. 

3. 3. 4. 8. 6  The  regression  equation  developed  was; 

Z  «  log  M  ^  -  3.44326  >  0.02142  A  -  0.02335  6  (3.17) 

c  ^  ct— c 

-  0.02170  C 

with  a  multiple  correlation  coefficient  oft 
0.964 

and  standard  error  of: 

0.09580  log  minutes 

The  regression  coefficients  of  A,  B,  and  C  were  tested,  by 
the  t  test,  at  the  5%  level  and  were  significant.  Figure 
3.5,  "Communications  Equipment  Data  -  Observed  vs.  Predicted," 
shows  the  individual  task  times.  13ie  outer  pair  of  diagonal 
lines  represents  the  two  standard  errors  inherent  in  using 
the  nomograph.  The  inner  pair  represents  the  two  standards 
errors  in  using  the  new  equation. 

3.3.5  Summary  -  The  full  design  predictions  made  were 
successful  in  that  they  correlated  with  the  data  gathered 
from  the  field.  Comparison  of  the  means,  M^ax«  dis¬ 

tributions  as  a  whole  were  uniformly  successful  in  each 
case  when  comparison  was  made  between  the  predicted  data 
and  the  data  collected  in  the  field.  The  equations  developed 
for  each  equipment  from  the  field  data,  cc»npared  quite  well 
with  equation  (3.1)  on  which  the  predictions  were  based. 

The  preliminary  prediction  on  the  AN/FPS-6  failed  to  corre¬ 
late  with  the  field  data.  Possible  reasons  are  cited  in 
paragraph  3. 3. 4. 5. 2. 


Predicted 
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3*4  Klectronlc  Maint»n«nc«  Profici«ncv  Teat 

The  prim*  objactlv*  of  thia  program  la  to  damonatrate  a 
pradlctabla  ralatlon  batwaen  tho  Bloctronic  Malntenanca 
Proficiency  Teat  (EMPT) «  developed  under  Contract  AF30(602)-- 
2057.  and  maintenance  (repair)  time.  Additionally,  the  pro¬ 
gram  aeeka  to  eatabllah  the  exlatence  of  maintenance  akllla 
and  Identify  them.  Through  the  Identification  of  main¬ 
tenance  akllla  and  the  ability  to  relate  auch  akllla  to  the 
time  criteria.  It  %irould  be  poaalble  to  equate  the  maintenance 
performance  of  different  technician  claaaea.  Specifically, 
the  ability  to  relate  the  performance  of  a  contractor  tech¬ 
nician  to  that  of  an  Air  Force  technician  would  be  moat 
valuable  during  maintainability  apeclflcatlon  demonatratlon. 

3.4.1  Background  -  Development  of  the  EMPT  atemmed  from 

an  attempt  to  quantify  the  human  element  In  the  maintenance 
proceaa.  nie  teat  la  comprlaed  of  ten  aubgroupa  dealgned 
to  evaluate  a  maintenance  technician' a  mental  and  motor 
akllla.  In  general,  the  emphaala  In  the  BNPT  la  on  under- 
a tending,  rather  than  on  rote  memory  of  facta.  Although 
aome  of  the  avibteata  require  the  recalling  of  facta,  they 
do  not  form  a  major  part  of  the  EMPT,  where  uaed,  they  are 
conaldered  aa  an  attempt  to  Include  Itema  that  ahould  be 
generally  known  to  an  experienced  technician. 

3.4. 1.1  Teat  Conatructlon  -  Teat  conatructlon  followed  the 
general  format  of  the  well  known  Wechaler  Adult  Intelli¬ 
gence  Scale.  Conatructlon  atepa  Includedt 

a.  Item  conatructlon 

b.  Item  review 

c.  Editing 

d.  Preliminary  tryout 

e.  Preteatlng 

f.  Teat  analyala 
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g.  Item  analysis 

h.  Item  selection 
1.  Item  ordering 

j.  Final  revision 

k.  Test  scoring  reliability 

Completion  of  these  steps  led  to  qualification  trial  per¬ 
formed  at  Keesler  Air  Training  Command.  The  trial  employed 
students  and  instructor  personnel  drawn  from  the  training 
center.  Criterion  for  the  validation  was  time  to  repair 
six  selected  maintenance  tasks  from  the  AN/P8T-2,  Data 
Coordinate  Transmitting  Equipment. 

3. 4. 1.1.1  Analysis  of  data  derived  from  this  program  re¬ 
vealed  that  no  correlation  could  be  ested>lished  between  . 
the  criterion  (repair  time)  and  the  observed  EMPT  scores 
(total  or  subgroups) .  This  difficulty  was  believed  to  be 
possibly  attributable  to  the  following: 

a.  The  varying  degree  of  specific  equipment  experience 
possessed  by  the  test  subject  resulted  in  an  un¬ 
explainable  variance. 

b.  Crlterior  tasks  drawn  from  the  AN/FST-2  equipnent 
did  not  represent  a  sufficient  range  of  maintenance 
skill  requirements. 

c.  Reliability  of  repair  time  remains  suspect  as  to 
Its  use  as  a  qualifying  criteria. 

3. 4. 1.1. 2  In  an  effort  to  secure  resolutlbn  to  these 
problem  areas,  the  program  set  forth  in  the  following 
discussion  was  estciblished. 
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3.4.2  Validation  Program  -  The  validation  program  followvd 
waa  a  t%ro  a  tap  atu^.  lha  initial  taat  phaaa  waa  daalgnad 
primarily  to  aaaaaa  tha  rallablllty  of  malntananca  par- 
formanca  and  tha  raaultant  tlma  orltarlon.  Hara  a  aingla 
taak  waa  admlnlatarad  to  a  group  of  forty  tachnlciana  on  a 
taat  >  rataat  baaia.  Corralation  of  tha  taat  -  rataat 
data  providad  a  baaia  for  tha  rallablllty  avaluatlon  of 
tha  critarlon.  Iha  final  taat  phaaa  incorporatad  Into  tha 
taat  aaquanca  fiva  additional  taaka,  %diloh  providad  data 
for  corralation  with  tha  BNPT  acoraa.  nia  aacond  phaaa 
waa  llmltad  to  tha  twanty-flva  tachnlciana  poaaaaalng  tha 
hlghar  taat  >  rataat  ralationahipa  during  phaaa  1. 

3.4. 2.1  Program  Davalopmant  -  lha  baaic  objactiva  of  tha 
initial  taatlng  phaaa  waa  to  aatabliah  tha  raliability  of 
malntananca  tlma  and  juatify  Ita  uaa  aa  a  critarlon  for 
maaauramant  of  tachnlclan  parformanca.  lha  raliability  if 
provan  would  provida  a  aound  baaia  on  which  to  procaad 
toward  the  validation  of  tha  Blectronica  Malntananca  Pro- 
flclancy  Teat  (SHPT)  aa  a  predictor  of  tachnlclan  parformanca. 
A  further  objective  of  tha  initial  phaaa  waa  to  identify 

a  range  of  dlacernable  malntananca  akllla.  Theaa  akllla  Whan 
related  to  apeclfic  malntananca  taaka  will  provida  a  maana 
of  aalactlng  a  group  of  rapraaantativa  taaka.  Uaa  of  thiu 
taak  group  in  tha  formal  validation  program  will  aaaure  that 
all  Inqportant  akllla  are  employed.  The  following  dircuaalon 
presenta  the  akllla  and  taaka  aalectad  and  an  aaaoclatad 
deacription  of  the  techniquaa  employed. 

3. 4. 2. 2  Skill  Selection  -  The  identification  of  maintenance 
akllla  waa  approached  by  reviewing  tha  maintenance  procaaa. 

For  the  Identification  procedure  a  akill  waa  defined  aat 

a  developed  or  acquired  ability  to  perform  a  particular 
act.  With  thla  context  in  mind  the  examination  of  the 
maintenance  proceaa  led  to  the  eatabliahment  of  the  following 
general  akllla s 

a.  Teatlng  and  meaaurlng  -  Teating  and  meaaurlng  rafera 
to  the  mental  and  phyalcal  acta  of  aecuring  equip¬ 
ment  atatua  information  through  the  uaa  of  teat 
equipment . 

Examples  Obaerve  a  waveahape  on  an  oacilloacopa 
and  obtain  the  maximum  and  minumum  valuer  of  the 
wave. 
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b.  Verbal  -  Verbal  skill  refers  to  the  ability  to 
carry  out  oral  Instructions  and  Includes  under¬ 
standing  of  the  jargon  and  abbreviations  used  in 
electronics. 

Ixamplet  You  are  told  to  measure  the  MDB  and 
SWR  of  a  system. 

c.  Written  cotoprehenslon  -  nils  skill  refers  to  the 
ability  to  understand  technical  orders  and 
schematics,  fill  out  forms,  make  out  reports, 
etc. 

Exangilet  Tracing  the  AVC  circviit  on  a  schematic 
and  noting  possible  sources  of  trouble. 

d.  Electrical  manipulative  -  nie  actions  performed 
on  electrical,  electronic,  and  electro-mechanical 
circuits. 

Example:  Soldering  a  resistor  to  two  terminals. 

e.  Mechanical  manipulation  -  The  action  performed  on 
mechanical  items. 

Example:  Dismantling  a  clutch  used  in  a  radar 
antenna. 

f.  Electronic  -  Ihe  ability  to  apply  knowledge  of  the 
electronic  functioning  and  the  physical  characteris 
tics  of  equipments/  components,  circuits,  and  parts 

g.  Logic  -  Ihe  ability  to  solve  problems  logically 
with  respect  to  components  within  equipment, 
circuits  within  component,  and  parts  within  circuit 

h.  Safety  -  The  ability  to  perform  maintenzmce  in 
a  safe  manner. 

It  was  the  opinion  of  the  engineers  concerned  with  the 
study  that  the  skills  listed  were  present  in  all  maintenance 
tasks  to  varying  degrees.  To  ascertain  the  degree,  on  the 
basis  of  engineering  judgment,  did  not  appear  to  be  within 
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the  realm  of  technical  feasibility.  Rather,  It  was  felt 
that  auch  division  could  only  be  made  from  an  analysis 
of  data  developed  expressly  for  this  purpose. 

3. 4. 2. 2.1  As  stated,  the  eight  skills  listed  appear  In  all 
tasks  but  It  was  noted  that  these  skills  may  differ  widely 
depending  upon  the  level  at  which  maintenance  Is  performed. 
Specifically,  maintenance  performed  on  electronic  devices 
may  be  performed  at  the  systMi,  equipment,  conqponent, 
circuit,  and  part  levels.  A  technician  In  performing  a 
task  may  work  solely  at  one  level  or  traverse  the  total 
complement.  The  ability  to  perform  at  one  level  o«rtalnly 
does  not  assure  satisfactory  performance  at  the  others, 
for  example,  a  technician  skilled  In  performing  maintenance 
at  the  equipment  level  (Isolating  and  replacing  black  boxes) 
may  be  completely  Incapable,  without  additional  training 
and  experience,  of  working  effectively  at  either  the  sys¬ 
tem  or  the  conqxinent  level. 

3. 4. 2. 2. 2  On  this  basis.  It  was  felt  that  the  general 
skills  take  on  unique  characteristics  at  different  levels 
of  application.  Since  these  levels  are  readily  discernible 
It  was  recommended  that  tasks  be  developed  reflecting  the 
various  maintenance  levels  and  associated  skills. 
Specifically,  tasks  were  developed  to  reflect  the  general 
skills  associated  with  the  following  levels i 


a.  Equl|xnent  - 

b.  Component  - 

c.  Circuit 

d.  Part 


> 

j 


General  Skills  1  through  8 


The  validation  program  permits  determining  analytically  If 
significant  differences  exist  between  the  four  specific 
skill  areas.  Knowledge  of  such  difference  will  be  of 
significant  value  In  guiding  the  design  of  future  equipments. 

3. 4. 2. 3  Task  Selection  -  for  the  validation  program  the 
RCA  Electronic  Trainer  Model  121  was  used  to  form  the  equip¬ 
ment  on  vdilch  maintenance  was  performed.  This  choice  was 
predicated  on  the  inherent  flexibility  of  this  device,  which 
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!•  achieved  by  the  uee  of  plug-in  asseioblieB  at  both  tha 
circuit  and  part  leva la. 

3. 4. 2. 3.1  Equipment  Selection  -  The  electronic  trainer 
offered  a  choice  of  seven  basic  equipment  types  which  may 
be  constructed  from  the  circuits  provided.  These  includes 

a.  Audio  Anyalifier 

b.  Superheterodyne  Receiver 

c .  Radar  System 

d.  Radar  Timing  Equipment 

e.  Marker  Indicator  Equipment 

f .  Range-Notch  Equipment 

g.  Pulsed  Radar  Equipment 

The  superheteroi^ne  receiver  and  marker  indicator  equip¬ 
ments  were  chosen  for  the  experimental  procedure  because 
theys  (1)  represent  analog  smd  digital  equipment  respeotlvely« 
(2)  are  relatively  sophisticated  in  performance  and  con¬ 
struction!  and  (3)  offered  suitable  operational  stability 
for  a  long  term  experiment. 

3. 4. 2. 3. 2  Task  Identification  -  Por  the  selected  equipments 
a  total  of  229  tasks  were  identified  and  related  to  the 
basic  parts.  Table  3.9.  “Marker  Indicator  Tasks  (Partial)#" 
presents  a  partial  listing  of  the  tasks  identified.  Here# 
the  tasks  are  listed  with  a  numerical  identification  of  the 
mode  of  failure  at  the  part#  circuit#  component  and  equip¬ 
ment  level.  Table  3.10#  “Failure  Mode  Identification#" 
identifies  the  failure  codes  esployed.  The  failure  m^e 
analysis  contained  on  Table  3.9  is  used  in  the  task  selection 
as  a  guide  to  secure  a  range  of  frequently  occurring  mal¬ 
function  symptoms. 

3. 4. 2. 3. 3  Selection  Plan  -  In  accordance  with  the  postulate 
that  discreet  maintenance  skills  exist  for  maintenance 
performed  at  the  equipment#  component#  circuit#  and  part 


TABLE  3.9 

MARKER  INDICATOR  TASKS  (Partial) 
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1  Fallura 

Modaa 

II 

Circuit 

Conqponant 

Equipmant 

R5201 

C5201 

V5201 

V5201 

VS201 

R5204 

C5204 

RS205 

C5205 

C5205 

R6401 

R6402 

V6401 

V6401 

V6401 

C6401 

R6403 

R6404 

R6405 

C6402 

C6402 

R7301 

V7301 

V7301 

V7301 

R7302 

C7301 

S7301 

C7302 

C7302 

L7301 

C7303 

C7303 

R7801 

V7801 

V7801 

V7801 

C7801 

R7803 


V8301 

V8301 
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TABLE  3.10 

FAILURE  MODE  IDENTIFICATION 


Parte 

1.  Open 

2 .  Shorted 

3.  Low  Transconductance 

4.  Open  Filament 

5.  Grid  to  Cathode  Short 

6.  No  Contact 

7.  Low  Emission 

8.  Plate  to  Cathode  Short 

9.  Air  Leak 

10.  Grid  to  Grid  Short 

11 .  Grounded  Terminal 

Circuits  &  Components 

1.  NO  Output 

2.  on  Output 

3.  Incorrect  or  Wrong  Waveshape 

4.  Weak  or  Low  Output 

5 .  Changed  Waveshape 

6.  None 

7.  Wrong  Fraquency  &  Waveshape 

8.  Phase  Shifted  Output 

9.  Increased  Intensity 

10.  Wrong  Frequency 

11.  Weak  Distorted  Output 

12.  Oscillation 

13.  Distorted  Output 

14.  Normal  Output  No  AVC 


Equipment 

1.  Long  Sweep  and  No  Narks 

2.  Long  Free  Running  Sweep 
&  No  Marks 

3.  Jittery  Display 

4.  Long  Sweep  &  Jittery 
Marks 

5.  Increased  Nark  Abh 
litude 

6.  Decreased  Nark  Am- 
litude 

7.  Ho  Marks 

8.  Negative  6  Positive 
Marks 

9.  Short  Sweep  with  TWO 
Marks 

10.  Long  Unstable  Sweep 

11.  Short  unstable  Sweep 

12.  Unstable  Sweep 

13.  No  Sweep 

14.  Long  Invisible  Sweep 

15.  Sweep  Shifted  Right 

16.  Ho  CRT  Display 

17.  Display  Out  of  Focus 

18.  Increased  Intensity 

19.  Sweep  Low  Left  &  In¬ 
tensity 

20.  Sweep  Low 

21.  Sweep  Left 

22.  Short  Sweep  6  Short 
Mark 

23.  Spot  on  Scope 

24.  Long  Sweep  with  Ripples 

25.  Change  in  Nark  Pos. 

26.  Weak  Unstable  Sweep 

27.  HOne 

28.  Reduced  or  Weak  Output 

29.  NO  Output 

30.  Weak  Distorted  Output 

31.  Ho  AVC 

32.  Oscillation 


the  eelectlon  plan  calls  for  equal  saaqplea  (tasks) 
to  be  established  for  each  level.  Table  3.11,  "Task 
Selection  Fonsat,"  Illustrates  the  format  to  be  used.  It 
will  be  noted  that  three  tasks  are  established  for  each 
equipment  and  these  are  comprised  of  one  task  at  saoh  level. 
Task  selection  Is  accomplished  by  determining  and  selsetlng 
parts,  circuits,  and  ccsyponents  associated  with  the  most 
frequently  occurring  modes  of  failure  for  the  two  equipments. 
AssiensMnt  of  a  particular  mode  to  a  speeifie  maintanones 
level  is  accoa9lished  random  selection.  Task  administra¬ 
tion  sequence  Is  also  determined  through  the  random  process. 

3. 4. 2. 3. 4  Selection  Results  -  Table  3.12,  "Marker  In¬ 
dicator  Failure  Modes  presents  the  results  of  analysing 
the  failure  modes  of  the  Marker  Indicator.  Mere  the  s»st 
frequently  occurring  modes  have  been  related  to  the  com¬ 
ponent  and  circuits  of  this  equipment.  Ihe  three  circled 
entries  Indicate  the  modes  snd  the  associated  coagponent 
and  circuits  to  be  utilised  for  this  equipaient.  Mots  that 
there  is  a  tie  between  nodes  10  and  11  and  each  involves 
12  occurrences.  An  Investigation  of  the  reliability  rates 
of  the  parts  involved  Indicated  that  mode  10  would  occur 
more  frequently. 

3. 4. 2. 3. 5  A  similar  analysis  was  nmAm  for  the  receiver 
and  the  results  are  presented  in  Table  3.13,  "Aecelver 
Failure  Modes,"  the  circled  entries  Indicate  the  choices 
made.  A  slight  departure  from  the  established  routine  was 
made  here  In  assigning  mode  29  to  the  detector  circuit  of 
the  2nd  detector  component  in  lieu  of  the  1st  detector. 

Ihls  choice  was  made  since  mode  28  so  clearly  related  to 
the  1st  detector  component,  and  the  chosen  assignment  pro¬ 
vided  a  better  task  balance  within  the  receiver. 

3. 4. 2. 3. 6  Random  selection  process  was  used  to  relate 
the  chosen  failure  modes  to  the  maintenance  levels  and  the 
task  sequence.  Table  3.14,  "Selected  Tasks,"  presents  the 
results  of  this  selection.  In  the  case  of  the  conqponent 
and  circuit  task  the  failure  mode  analysis  dictated  the 
specific  area  chosen.  For  the  part  task  rcmdom  selection 
was  used  to  designate  the  actual  part  Indicated. 

3. 4. 2. 3. 7  Table  3.15,  "Task  Introduction  Method,"  Identifies 


TABLE  3.11 
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th«  spttclflc  part  manipulation  methods  necessary  to  aChiavi^ 
the  failure  modes  associated  with  the  component  and  circuit 
tasks.  Additionally,  It  Identifies  tdie  failure  mode  for 
the  two  part  tasks.  All  selected  tasks  were  OMratlonally 
verified  to  assure  that  the  stated  mode  of  failure  would 
produce  the  desired  result. 

3.4.3  Initial  Test  Phase  -  The  electronic  technicians  used 
for  the  experimental  procedure  were  drawn  frcai  the  engineering 
support  staff  of  the  RCA  plant  at  Burlington,  NassaOhusetts. 
These  personnel  may  be  considered  typical  of  those  who  would 
be  utilized  In  maintainability  demonstration  testing  as 
called  out  In  current  specifications.  The  test  sasqple  was 
drawn  from  personnel  classified  Into  the  following  three 
job  descriptions t 

a.  Laboratory  Technician  -  Responsible  for  fabricating 
proposed  circuit  designs  under  close  engineering 
supervision.  Also,  responslbls  for  tests  cosh 
pleted  on  electronic  systems  during  manufacturing 
phase . 

b.  Senior  Laboratory  Technician  >  Duties  Identical 
to  laboratory  technician  bui  requires  less  direct 
supervision. 

c.  Engineering  Technician  -  NOrks  closely  with  design 
engineers  preparing  circuit  breadboards  of  newly 
designed  circuits  and  tests  new  devices  to  ascer¬ 
tain  operational  parmeters.  Works  with  minimal 
supervision. 

3.4. 3.1  The  principal  criterion  used  to  select  technicians 
were;  (1)  capability  of  performing  assigned  task  and  (2) 
availability  for  entire  test  period.  The  distribution  by 
classes  of  the  forty  technicians  selected  were  as  follows  i 

I  Laboratory  Technician  5 

^  Senior  Laboratory  Technician  21 

I  Engineering  Technician  ^ 


60 


It  waa  originally  intandad  to  draw  nearly  equal  Baaqplae 
from  each  of  the  three  groups  but  it  was  found  that  Beyeral 
the  leaser  skilled  laboratory  tedinieians  aiere  ttttibl,s  to 
cmoplete  the  task,  those  failing  w%re  rmleoed  wltik  teoli* 
niciana  from  the  higher  categories  '■j  adhleve  tke  full  test 
group.  Additionally,  the  requirement  for  availability 
during  the  entire  duration  of  the  test  program  influenoed 
the  saaq[>le  distribution  to  some  degree.  TSble  IX-1« 
"Biographical  Data, "  (Appendix  II)  reviews  the  pMrtiaent 
data  for  each  technician  selected. 

3. 4. 3. 2  The  technicians  used  in  the  test  procedure  had  no 
previous  experience  on  the  particular  t;^  of  oeMU^lSMnt 
selected.  To  provide  the  appropriate  badkgrouad  a  standardised 
training  session,  explaining  the  operation  and  sMintenanoe 
procedures  for  the  equipment,  was  given  to  eaflh  tedhnieian. 

3.4. 3. 3  ZasK  ^i-nlstyaUftn  ffgatautf  *  Oonsiderabls 
attention  was  devoted  to  standardising  the  teat  snviron> 
ment,  test  equipment  status,  and  equips^nt  oonditien  for 
each  task  administration.  Figure  1.6,  "Bquipasmt  Arranga- 
ment, "  Illustrated  the  layout  utilised  for  the  experiment. 

Prior  to  the  start  of  eaOh  test,  the  equipsMnt  was  placed 
in  the  position  shown.  Additionally,  the  following  pretext 
checks  were  madei 

3. 4. 3. 3.1  Equipment  Status  at  Start  of  BaCh  Task  Adminis¬ 
tration. 

a.  RCA  121  Trainer 

Equipment  operated  and  its  operation  conqplotely 
verified  and  optimised.  Subject  fault  part  installed 
and  symptoms  of  failure  verified.  Power  switch  and 
B-t-  switches  positioned  at  "ON". 

b.  VOM 

Physically  placed  immediately  to  the  left  of  the 
trainer.  Selector  switch  positioned  at  "lOOOV". 

Range  switch  positioned  at  "DC".  Test  leads  (red 
&  black)  inserted  in  meter. 


FIGURE  3.6 
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c.  Oacilloscope 

Physically  placed  immediately  to  the  left  of  the 
VOM  and  positioned  to  face  s\d)ject  when  standing 
In  front  of  trainer.  Volts  per  CM  Selector  posi¬ 
tioned  at  "20".  Time  per  CM  Selector  positioned 
at  "0.5"  msec/CM.  Sync.  Selector  positioned  at 
"Auto".  Oscilloscope  ground  externally  connected 
to  trainer  unit.  Power  switch  positioned  at  "OM". 

d.  Signal  Generator 

Physically  placed  to  the  loft  and  to  the  rear  of 
the  VOM.  Mo  leads  connected. 

In  addition  to  the  actions  outlined  above,  all  tost  equip¬ 
ment  was  calibrated  prior  to  the  Initial  testing  and  proper 
operation  continuously  verified  throughout  the  st\idy. 

3. 4. 3. 3. 2  The  observers  utilised  In  the  experimental  pro¬ 
cedure  were  personnel  experienced  with  data  collection 
techniques  and  were  thoroughly  familiar  with  all  aspects 
of  testing  procedure.  Prior  to  the  start  of  the  actual 
testing,  several  dry  runs  were  accoeg>llshed  to  assure  that 
all  administration  details  had  been  established. 

3. 4. 3. 3. 3  Supplementary  to  this  procedure,  the  following 
verbal  Introduction  of  the  subject  to  the  task  was  employed. 

a.  "Our  task  Is  concerned  with  the ... (Superheterodyne 

recelver/Narker  Indicator.) 

b.  The  failure  Is  at  the... (part,  circuit,  component) 
level.  (Due  to  confusion  surrounding  the  word 
"Component"  a  description  of  a  part,  circuit,  and 
component  Is  given.) 

c.  There  Is  only  one  failure  and  we  want  you  to  locate 
It  to  the  responsible. .. (part,  circuit,  component.) 

d.  You  may  have  a... (part,  circuit,  conqponent)  replaced 
any  time  you  wish  by  asking  for  It. 
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•  •  Any  tliM  a  part  la  raplacad  or  aoaia  eorractlva 

action  la  taken  we  want  you  to  verify  the  replace¬ 
ment  action. * 

Through  the  attention  given  to  procedure  detail «  It  la 
felt  that  variance  due  to  extraneoua  factotra  haa  been  re¬ 
duced  to  a  minimum.  The  data  reaultlng  from  thla  experi¬ 
ment  ahould  be  almoat  totally  a  function  of  the  Individual 
technician  proficiency. 

3. 4. 3. 4  pifel-aMlYfi;  -  time  data  (teat-reteat)  are 
preaented  In  Tablea  11-2  and  11-3  (Appendix  II)  reapec- 
tlvely.  In  addition  to  the  total  tlM*  the  tablea  preaent 
the  compoaltlon  of  total  time  In  terma  of  the  five  dealg- 
nated  elamenta.  Figure  3.7,  "Time  Blement  Dlatrlbutlon, * 
preaenta  a  comparlaon  of  percentage  dlatrlbutlon  for  test 
and  rateat  agalnat  the  prevloualy  obaerved  field  data. 

It  will  be  noted  that  for  the  aelected  taak  a  marked 
almllarlty  exlata  between  the  teat-reteat  meaauramanta . 
Additionally,  a  good  relatlonahlp  exlata  with  the  prevloualy 
collected  field  data. 

3.4. 3.4.1  Figure  3.8,  "Teat-ReteatCorrelatlon  (40)," 
preaenta  the  analyala  made  to  determine  the  correlation 
(reliability)  for  the  full  teat  data.  The  calculated  r 
waa  found  to  be  0.12  (5%  level  0.31).  Thla  calculation 

waa  made  by  ualng  the  logarithm  of  the  time  data  and  grouped 
analyala  method.  The  columna  marked  ^  Indicate  the  frequency 
of  each  cell  interval  and  portraya  the  general  form  of  the 
underlying  dlatrlbutlon.  The  teat  data  haa  tranaformed 
generally  to  the  normal  configuration  while  the  reteat  re- 
malna  akewed  to  aome  extent.  The  calculated  coefflcienta 
of  variation  indicate  that  the  log-normal  dlatrlbutlon 
may  be  uaed  for  the  analyala. 

3. 4. 3.4. 2  Figure  3.9,  "Teat-Reteat  Correlation  (25)," 
preaenta  the  analyala  of  the  time  data  for  25  aelected 
aUbjecta.  The  aelectlon  waa  made  by  Including  thoae  aub- 
jecta  which  lay  along  the  blaectlng  line  of  the  angle 
formed  by  the  teat-reteat  orthogonal  normallaed  acalea. 

Thla  technique  pexmlta  aelectlng  aUbjecta  who  poaaeaa  not 
only  good  teat-reteat  relationahlpa  but  additionally. 


TIME  elements 


3.7 


10 


10 


ti 

01 

M 


2.2686 

2.0042 

1.7396 

1.4750 

1.2104 

0.9458 

0.6812 


17 

30  3 

XI 

8 

13 

14 

31 

1C 

27 

34, 3€ 

35 

39 

28 

in 

n 

00 

fO 

n 

vs 

. 

• 

o 

p 

I 


FIGURE 


10 


5 


3 


2 


£ 


_ 

H 

lyiiiii 

7.21 

20 

4 _ 

7 

6 

12 

22,2  3 

2 

1 

■ 

9 

i9 

5, 36 

18 

37 

7 

32 

23 

15,29 

16,26 

40 

10 

25 

24 

5 

ov 

VO 

n 

o 

M 

fo- 

M 

H 

N 

H 

H 

o 

O 

O 

fM 

VO 

00 

« 

X 

r 

■9’ 

■s< 

H 

H 

H 

nZTSCT 
(Log  Min.) 

1.8.  TEST-RBTEST  CORRELATION 


(N  -  40,  r  -  .12) 


67 


provides  a  continuous  range  of  test  times.  The  calcu¬ 
lated  r  for  the  selected  group  was  determined  to  be  .806 
(5)4  level  0.40)  %ihlcih  Is  highly  significant.  Distributions 
for  test-retast  are  close  approximations  to  the  normal  as 
evidenced  by  the  f  columns. 

3. 4. 3. 4. 3  For  the  twenty-five  selected  technicians  the 
conqposltlon,  with  respect  to  job  classlflcatlon«  wae  as 
follows! 


Laboratory  Technician  S 
Senior  Laboratory  Technician  12 
Engineering  Technician 


Examination  of  the  job  classification  groups  along  the 
regression  line  fotmd  them  to  be  generally  positioned  In 
accordance  with  their  respective  skill  levels. 

3.4.4  Final  Test  Phase  -  The  five  remaining  tasks  selected 
during  tihe  program  idevelopment  were  administered  to  the  25 
technicians  possessing  the  greater  test-retest  reliability 
displayed  In  the  Initial  test  idhase.  Again,  two  adminis¬ 
trations  were  made  for  each  task.  (See  Appendix  IX  for  a 
breakdown  Of  test- retest  data  for  five  tasks  by  elanents. 
Table  11-4  through  11-13  provide  this  data.)  Adminis¬ 
tration  of  the  Electronics  Maintenance  Proficiency  Test 
(EMPT)  was  made  In  the  interval  between  the  task  test- 
retest. 


3.4.4. 1  Data  -  The  Information  developed  from  this  se¬ 
quence  Is  presented  In  Table  11-14,  "EMPT  Scores,"  (Appendix 
II)  and  Table  11-15,  "Log  Valuee  of  Met*"  (Appendix  11). 
Table  11-14  presents  the  EMPT  B\d»test  scores,  siibtotal, 
and  total  scores.  The  subtotal  scores  encompass  subtests 
1,  3,  4,  5,  6  and  7  related  to  verbal  skills;  whereas, 
subtotal  2,  8,  9  and  10  Is  a  measure  of  performance. 

(To  ease  subsequent  calculation  all  scores  have  been 
divided  by  10.)  Table  11-15  (Appendix  II)  presents  the 
logarithm  of  the  observed  maintenance  time  (Net)  (or  six 
tasks  Including  both  test  and  retest.  Use  of  the  loga¬ 
rithm  Is  dictated  by  the  underlying  log  normal  dlstrl- 
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butlon  of  malntonance  time.  In  both  tablas*  a  nuMrloal 
refarence  to  tha  class  of  tachnlclana  amployad  haa  baan° 
mada,  plus  thalr  grouping  In  accordanca  with  asalgnad  job 
catagorlaa.  Tabla  3.16,  "Data  -  Maana  and  ftahdaM 
Oavlatlon, "  aunraarlBes  tha  eharactariatlcn  of  tha  obaarvad 
information. 

3. 4. 4. 2  Data  itoalvaia  -  lAia  final  taat  phaaa  analysis 
sought  to  provida  ana%irora  to  tha  following  qtaastionsi 

a.  Is  malntananca  tlma  a  sui tabla  and  raliability 
maaaura  of  malntananca  profiolanoy? 

b.  Do  malntananca  skills  axlst? 

c.  Can  tha  BMPT  (daslgnad  to  maasura  malntananca 
skills)  be  relatad  to  tha  tlma  crltarla? 

Tha  following  analysis  will  Investigate  these  questions. 

3. 4. 4. 2.1  Time  Crltarla  -  Basic  to  tha  Investigation 
being  made  Is  tlie  suitability  time  as  a  maasura  of  maln¬ 
tananca  proficiency.  It  may  be  reasoned  that  should 
Individual  technicians  or  groups  exhibit  consistent  main¬ 
tenance  performance  with  respect  to  time  that  this  crltarla 
may  possess  some  validity.  To  examine  this  point  further 
a  correlation  was  made  between  test  and  retest  task  times 


and  results 

obtained 

are  contained  In  the 

following  tablet 

Retest 

1 

1 

.019 

2 

111 

6  Total 

2 

.449 

t!l  ^ 

.503 

i  ^ 

5 

-.082 

.570 

6 

.806 

Total 

.606 
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TABLE  3.16 

DATA  -  NBAM8  AMD  STANDARD  DEVIATION 


EMPT 

Means 

Standard  Deviation 

1.  Vocabulary 

15.28 

5.62 

2.  Equipment  Recognition 

10.56 

2.50 

3.  Analogies 

9.16 

1.65 

4.  Cioaqprehension 

15.08 

3.25 

5.  Coiiq>utation  Problems 

7.32 

2.95 

6.  Similarities 

10.36 

2.45 

7 .  Information 

7.84 

2.36 

8.  Absurdities 

18.40 

5.29 

9.  Picture  Arrangement 

9.60 

1.91 

10.  Basic  SXllla 

18.28 

6.32 

11.  Verbal 

65.04 

14.17 

12 .  Performance 

56.84 

10.78 

13.  Total 

121.88 

21.99 

Test 

Task  1 

1.3781 

0.2300 

Task  2 

0.7354 

0.1376 

Task  3 

0.8108 

0.1700 

Task  4 

0.8676 

0.2313 

Task  5 

0. 8604 

0.2516 

Task  6 

1.3556 

0.3971 

Total 

1.9161 

0.1990 

Retest 

Task  1 

1.0848 

0.2500 

Task  2 

0.7187 

0.2469 

Task  3 

0.7388 

0.1482 

Task  4 

0.8162 

0.2403 

Task  5 

0.7561 

0.2110 

Task  6 

1.1170 

0.2746 

Total 

1.7330 

0.1544 
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It  will  be  noted  that  tasks  1  and  4  did  not  correlate  idiile 
tasks  2',  3,  5  and  6  did  relate  significantly.  Hourrever*  the 
high  correlation  obtained  for  task  6,  it  will  be  recalled, 
was  obtained  through  the  direct  selection  of  technicians  on 
the  basis  of  good  test- retest  relations.  The  results  failed 
unfortunately  to  provide  a  definite  answer  to  the  suitability 
of  time  as  a  measure  of  maintenance  proficiency.  At  best 
it  appears  to  be  a  marginal  indication. 

3. 4. 4. 2. 2  Maintenance  Shills  -  The  existence  of  maintenance 
skills  was  soughr  by  establishing  that  significant  difference 
exist  among  technician  classifications  and  that  skill  re¬ 
quirements  differ  for  maintenance  tasks  associated  with 
part,  chassis,  and  component  replacement,  concepts.  Addition¬ 
ally,  the  possible  difference  between  skill  requirasttnts 
for  equipment  type  was  investigated.  Table  3.17,  "Analysis 
of  Variance  -  Maintenance  Time"  presents  the  format  used 
in  this  examination.  Bach  of  the  variables  considered  is 
identified  in  the  table.  The  results  obtained  are  presented 
in  Table  3.18,  "Analysis  of  Variance  -  Calculation."  It 
will  be  observed  that  significant  differences  were  obtained 
for  the  variables!  technicians  category  (A),  test- retest 
(B) ,  and  replacement  level  (p) .  Additionally,  a  signifi¬ 
cant  interactive  B  x  p  was  imtained.  Detailed  examination 
of  this  relationship  revealed  that  the  interaction  was 
probably  due  to  the  extremely  high  mean  square  value  of  the 
factor  (p)  rather  than  a  true  inter-relationship.  In  sum¬ 
mary,  this  examination  provides i 

a.  The  three  categories  of  tedhnicians  employed  in 
this  test  possessed  different  maintenance  capa¬ 
bilities  (skills) . 

b.  The  teat- retest  cycle  significantly  effects  main¬ 
tenance  time. 

c.  Different  skills  are  required  to  accomplish  main¬ 
tenance  at  the  part,  circuit,  and  congx>nent  levels. 

d.  Equipment  type  (function)  does  not  appear  to  in¬ 
fluence  maintenance  time. 
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Th*  possibltt  confounding  influonco  of  tho  tMt-rotost  otm- 
bination  was  oonaidorad  and  a  aaparata  analyaia  waa  WMla 
uaing  taat  data  only,  lha  raaulta  obtainad  ptoducad  tba 
aama  findings  outlinad.  Within  tha  linits  of  tins  date* 
to  daseriba  naintananoa  psofieiancy.  it  is  fait  tliat  tha 
axiatanca  of  shills  has  baan  danonstratad. 

3. 4. 4. 2. 3  MiPT  A^lyais  >  Iha  axanination  of  tha  ralatioa 
of  tha  mPT  to  aaintanama  tisM  bagan  by  raviaaing  tha 
intarnal  consistanoy  of  tha  tast.  TSbla  3.19,  *iiaipla 
Corralation  -  1MPT«*  prasants  an  invastigation  of  tm  ra- 
lationshipa  batwaan  subtasts,  varbal  and  parfotaanoa  aaasuraSf 
and  total  INPT  sooras.  It  will  ba  notad  that  tha  tast  is 
ganarally  wall  intar-oorralatad  with  tha.  axo^tion  of  sdb- 
test  2.  Aside  fsoa  this,  tha  test  appears  to  be  generally 
consistant. 


3. 4. 4. 2. 3.1  Table  3.20,  "Sisq^la  Correlation  -  Tast/hatast, ” 
axaainas  tha  relationship  between  the  INPT  and  tha  test- 
retest  data.  In  this  investigation  negative  ooeffieiants 
are  sought,  i.e.  high  BUT  score- low  naintenance  tisM.  A 
corralation  of  -0.379  was  obtained  for  total  mPT  score 
versus  total  test  tine  which  did  not  iseet  the  5  percent 
level  of  significance  (r  ■  0.400)  for  this  investigation. 
Other  coefficients  within  the  table  ranged  froM  -0.S72  to 
values  slightly  positive.  Correlations  with  the  retest 
data  did  not  achieve  the  levels  secured  for  tha  first 
adninistration.  Ihia  was  expected  due  tha  confounding  in¬ 
fluence  of  the  technician's  lasMdiate  ejqperience  with  the 
tasks. 


3. 4. 4. 2. 3. 2  From  this  examination  the  ability  of  the  INPT 
to  predict  malntenarice  proflciancy  as  evidenced  by  time 
has  not  been  proven.  The  magnitude  of  the  correlation 
coefficient  achieved  between  total  INPT  score  and  total 
task  time;  however,  does  provide  some  possible  evidence  to 
the  concept.  It  must  be  concluded;  however,  that  factors 
not  measured  by  the  BIPT  bear  a  greater  Influanee  on  main¬ 
tenance  time. 
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3.4.4«3  Simmiarv  -  from  the  foregoing  analyala«  it  appeara 
that  the  ability  of  aialntenance  time  to  function  aa  tiie 
aole  meaaure  of  maintenance  proficiency,  aa  determined  by  the 
BIPT,  la  queatlonable.  Further  Inveatlgatlon  la  needed  to 
determine  If  auch  factora  aa  degree  of  workmanahlp.  main¬ 
tenance  Induced  f allurea,  performance  reatoratlon,  and  other 
quantitative  meaaurea  do  not  alao  form  a  part  of  maintenance 
proficiency.  It  la  felt  that  meaaurea  of  theae  factora  com¬ 
bined  with  the  time  criteria  may  be  aucceaa fully  related  to 
technical  proficiency  providing  the  aolutlon  aought. 

3.5  Other  DeveWpiafntff 

3.5.1  Qeneral  -  In  addition  to  the  maintainability  pre¬ 
diction  technique  and  the  Blectronlc  Maintenance  Proficiency 
Teat,  other  procedurea  and  technlquaia  appilcij»le  to  main¬ 
tainability  engineering  were  developed  or  refined  during 
Phaae  V.  The  general  toplca  Inveatlgated  Include t 

a.  Theory  and  claaaiflcatlon  of  maintenance 

b.  Maintainability  planning  and  control 

c.  Maintainability  deaign  guidellnea 

d.  Deaign  review  methoda 

e.  Demonatratlon  tea ting 

f.  Field  data  acquialtlon 

Theory  and  claaaiflcatlon  of  maintenance  Included  the  dea- 
crlptlon  of  the  maintenance  proceaa  and  the  developnMnt  of 
a  ayatem  of  Indlcea  for  apeclfylng  and  meaauring  maintain¬ 
ability.  For  planning  and  control,  a  general  maintainability 
program  plan  waa  developed  along  with  a  description  of  the 
neceaaary  taaka  to  be  performed  and  the  type  of  peracumel 
required.  Ouldellnea  were  developed  for  dealgnlng  auilntain- 
ablllty  Into  an  equipment  for  reduction  of  peracmnel  and 
aupport  requlrementa .  A  technique  for  demonatratlng  the 
maintainability  achieved  by  an  equipment  deaign  waa  developed 
and  procedurea  for  gathering  maintainability  data  from 
operational  equipment  In  the  field  detailed. 
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3.5.2  Theory  and  Classification  of  Maintenanca  -  During 
the  course  of  the  field  data  collection  program  and  the 
laboratory  Investigations,  information  relating  to  tha 
basic  maintenance  process  and  to  maintenance  conditions 
was  developed.  Through  the  analysis  of  data  from  these  pro¬ 
grams  and  the  maintenance  experience  of  the  personnel  per¬ 
forming  these  analyses,  a  description  of  the  maintenance 
process  and  a  detailed  classification  system  evolved. 

In  addition,  a  system  of  maintenance  indices  for  quanti¬ 
tatively  describing  equipment  maintenance  were  developed. 

3. 5. 2.1  nie  maintenance  process  and  maintenance  classifi¬ 
cations  were  described  In  the  Phase  III  and  Phase  IV  pro¬ 
gress  reports. (3,4)  During  Phase  V,  this  material  was 
reviewed  and  compared  with  information  gathered  during 
the  field  validation  program.  In  addition,  comnents  were 
made  by  specialists  in  the  various  facets  of  maintain¬ 
ability.  As  a  result  of  this  review,  some  changes  and 
additions  were  made  to  the  original  material.  The  re¬ 
sulting  maintenance  theory  and  classification  is  presented 
in  Section  2,  Volume  II  of  this  report. 

3. 5. 2. 2  A  system  of  maintenance  indices  relating  to  the 
three  general  areas  of  time,  cost  and  capability  were 
previously  developed  and  presented  in  the  phase  III  pro¬ 
gress  report. (3)  A  review  of  these  indices  resulted  in 
the  change  of  the  maintenance  index  to  a  manning  index 
and  the  addition  of  an  operational  readiness  index.  In 
addition,  methods  for  calculating  index  values  and  for 
determining  the  relation  between  specified  and  observed 
indices  were  more  fully  developed.  The  new  list  of  in¬ 
dices  and  the  calculation  methods  are  presented  in  Section 
2,  Volume  II  of  this  report. 

3.5.3  Maintainability  Planning  and  Control  -  In  order 
to  meet  maintainability  design  o)3:)ectlveB,  procedures 
for  maintainability  engineering  must  be  established. 

These  procedures  must  Include t  delegation  of  responsi¬ 
bility,  program  planning,  design  guidelines,  control 
methods,  and  evaluation  techniques.  Design  guidelines 
and  a  maintainability  evaluation  technique  have  been  pre¬ 
viously  developed  and  presented  in  the  phase  IV  progress 
report. (4)  During  Phase  V,  the  remaining  procedures 
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necessary  for  a  maintainability  englneerina  prooram  were 
developea.  These  procedures  included  the  Identification 
of  the  tasks  associated  with  a  typical  maintainability 
program  and  the  relation  of  these  tasks  to  the  design- 
development  cycle.  Additionally,  the  requirements  for 
personnel  to  staff  such  a  program  %«ero  detailed.  The 
procedures  developed  are  presented  in  Section  3,  Volume 
II  of  this  report  in  the  form  of  a  typical  maintalnidiillty 
program  plan. 

3.5.4  Maintainability  Design  Quidelines  -  During  Phase 
IV  of  this  program  guidelines  ^or  designing  maintainability 
into  prime  equipment  were  developed.  During  Phase  V# 
these  guidelines  were  extended  to  include  tiie  personnel 
and  support  parameters.  These  guidelines  were  developed 
on  the  basis  of  the  data  collected  from  field  maintenance 
activities  and  from  laboratory  investigation  of  the  Blee- 
tronic  Maintenance  Proficiency  Test  (BMPT) . 

3. 5. 4.1  Equipment  Design  Factors  -  The  design  guidelines 
developed  during  Phase  IV  were  derived  from  information 
relating  to  the  design  parameter.  These  guidelines  were 
ordered  in  accordance  with  their  contribution  to  down  time. 
These  guidelines  were  reviewed  during  Phase  V  and  were  con¬ 
sidered  to  be  adequate  based  on  the  available  data.  An 
ordered  list  of  design  features  along  with  guidelines  for 
each  feature  is  contained  in  Section  A,  Volume  II  of  this 
report. 


3. 5.4. 2  Personnel  Factors  -  There  were  3  forms  and  1 
checklist  used  to  gather  information  concerning  maintenance 
personnel.  These  were  as  follows i 

a.  Checklist  D  -  Scoring  Personnel  Coordination 

b.  Attitude  -  Motivation  Test 

c.  Biographical  Data  Sheet 

d.  Electronic  Maintenance  Proficiency  Test 

Each  of  these  is  described  in  the  following  paragraphs. 
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3. 5. 4. 2.1  Checkliat  D  -  This  chaclcllat  waa  aoorad  during 
tha  parformanca  of  aach  malntananca  taak«  baaad  on  tha 
Intaractlona  of  tha  malntananca  taaai  aMBdaara.  Uiara  ara 
alx  quaatlona  In  thla  chackllat  whl^  daal  with  tha  fol¬ 
lowing  topical 

a.  Iha  apaad  with  which  Infonaatlon  la  trananlttad 
batwaan  taam  mandaara 

b.  lha  validity  of  tha  Information  tranamlttad 

c.  Tha  agraanant  aa  to  mathod  of  taak  parformatica 

d.  Tha  ralative  patlclpatlon  of  aacAi  taam  manbar 

a.  Tha  exlatance  of  paraonallty  confllcta  batwaan 
taam  mambara 

f.  Whathar  or  not  on- tha- job  training  waa  glvan 
during  the  maintenance  action 

3. 5. 4. 2. 2  Attitude  -  Motivation  Teat  -  Thla  la  a  paper 
and  pencil  teat  developed  to  aaaeaa  the  morale  of  main¬ 
tenance  peraonnal.  It  waa  glvan  once  to  aach  technician 
for  which  time  data  were  collected.  Thla  teat  conalata  of 
five  aubteata  which  meaaure  the  following  Charactarlatlca t 

a.  Extrlnalc  Job  Satlafactlon  -  The  job  work  oon- 
dltlona,  beneflta,  pay,  and  the  aecurlty  derived 
from  the  job. 

b.  Intrlnalc  Job  Satlafactlon  -  The  job  aatlafactlona 
vdilch  are  derived  from  direct  performance  of  tha 
work  Itaelf  and  which  tend  to  be  conatant  for  tha 
job,  regardleaa  of  where  the  work  la  performed. 

c.  Social  Aapecta  of  the  Job  -  The  job  aapacta  In¬ 
volved  In  the  relatlonahlp  of  the  technician  with 
other  technlclana,  eapeclally  thoae  at  a  congiarabla 
level . 
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d.  Ofiportunlty  for  AdvonowMiit  -  iho  joib  aapoeta 
%dii^  fha  Individual  aaaa  aa  potantial  aoureaa 
of  ioproving  hia  aoonoaiic  poaition.  atatus.  and 
profaaaional  axparianca. 

a.  Suparviaory  Ralationahipa  -  Tha  ralationa  that 
axiat  batwaan  tha  taohnioian  and  hia  tiaaadiata 
auparviaora . 

3. 5. 4. 2. 3  Biooryhical  Data  flhaat  -  Thia  ia  a  aurvay  form 
uaad  to  collaet  data  concarning  tha  training  and  atqparianoa 
of  aach  naintananca  tabhnioian.  Ihia  form  providad  for 
tha  oollaction  of  tha  following  datat 

a.  Pay  grada 

b.  Data  of  anliatmant 

C4  Aga 

d.  Bxparianca  on  aquipnant  on  which  maintananca  la 
balng  parformad 

a.  Achiavamant  in  alactronio  fundamantala  eouraa 

f.  Airman  Claaaiflcation  Battary>  or  Airman  Qualifi¬ 
cation  Bxaminatlon  taat  aooraa 

g.  Amount  of  formal  alactronloa  training 

h.  Amount  of  inatructlng  axparianca 

i.  Amount  of  practical  malntenanca  oxparienca 

j.  Amount  of  auparviaory  axparianca 

k.  Amount  of  axparianca  on  spaciflc  typaa  of  aquip- 
mant 

3. 5. 4. 2. 4  Elactronic  Maintananca  Proficiancv  Taat  -  Thia 
ia  an  Individually  admlnlatratad  taat.  conatructad  to 
avaluata  tha  tachnician'a  mantal  and  motor  akilla  impor¬ 
tant  to  maintananca  proficlancy.  niia  taat  contalna  tan 
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•ub- testa  which  are  as  follows! 

a.  Vocabulary, 

b.  Equipment  Recognition, 

c.  Analogies, 

d.  Comprehension, 

e.  Computation, 

f.  Similarities, 

g.  Information, 

h.  Absurdities, 

1.  Picture  Arrangement,  and 
j.  Basic  Skills. 

These  sub-tests  are  also  combined  Into  two  groups  for 
analysis  purpose.  These  groups  are  the  verbal  group  (a, 
c,  d,  e,  f,  and  g)  and  the  performance  group  (b,  h,  1, 
and  j ) . 


3. 5. 4. 2. 5  Relationships  -  Each  of  the  personnel  parameters 
measuring  Instruements  was  analyzed  with  respect  to  equip¬ 
ment  down  time.  The  checklist  D  (Scoring  Personnel  Coordl^ 
nation)  data  were  found  to  be  essentially  single  valued, 
thus  rendering  the  checklist  useless  for  further  analysis. 
The  total  Attitude— Motivation  Test  score  for  51  techni¬ 
cians,  for  which  time  data  were  available,  was  correlated 
with  active  down  time.  Ihe  resultant  coefficient  was  -  0.06 
which  Is  not  significant.  Since  the  reliability  of  the 
s\ib-test  scores  Is  less  than  that  for  the  total,  no  further 
analysis  was  made. 

3. 5. 4. 2. 6  The  Biographical  data  were  also  correlated  with 
down  time,  and  the  results  of  this  analysis  are  shown  In 
Table  3.21,  "Correlation  Coefficients  of  Personnel  Factors 
With  Log  Active  Down  Time." 
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TABLB  3.21 

CORREIATION  COSFFICZBBffS  OP  PBRSONHBL  PACT(»U3 
WITH  LOG  ACTIVE  DOWN  TINE 


Catecrorv 

11 

r 

P 

Age  (years) 

52 

.08 

N.8.* 

Time  In  Service  (years) 

43 

.15 

N.S. 

Practical  Maintenance 

Experience  (Months) 

43 

.08 

N.S. 

**ACB  -  Mechanical 

19 

.01 

N.S. 

***AQE  -  Mechanical 

34 

.13 

N.S. 

ACB  -  Electronics 

19 

.02 

N.S. 

AQE  -  Electronics 

34 

.06 

N.S. 

ACB  -  Technical  Specialty 

17 

.44 

.10  N.S 

AQE  -  Technical  Specialty 

22 

-.56 

.01  Slg 

*  -  N.S.  -  Not  Significant 
**  -  Airmen  Classification  Battery 

***  -  Airmen  Qualification  Examination 

Only  two  of  the  categories  approached  accepted  levels  of 
statistical  significance  (ACB  &  AQE  Technical  Specialty) . 
In  this  case  the  trends  are  In  opposite  directions  and  so 
tend  to  discredit  the  significance,  since  both  tests  are 
designed  to  measure  the  same  skill.  From  the  data  avail¬ 
able,  no  firm  conclusions  can  be  drawn.  Hone  of  the  other 
correlations  were  high  enough  to  suggest  any  relationships 
with  down  time. 


3. 5. 4. 2. 7  Two  separate  trials  were  made  to  validate  the 
Electronic  Maintenance  Proficiency  Test  (BMPT)  against  the 
down  time  criterion.  In  the  first  trial  the  AM/PST>2 
equipment  at  the  Kessler  Air  Training  Command  was  used. 

The  EMPT  was  administered  to  59  tecdinicians  who  were  sub¬ 
sequently  timed  while  performing  six  corrective  maintenance 
tasks  on  the  AM/PST-2 .  The  EMPT  proved  to  be  an  internally 
consistent,  mechanically  smooth,  reliably  scored  test. 
However,  neither  tlie  scores  on  the  sub- tests,  nor  the  total 
score  exhibited  any  meaningful  correlations  with  active 
down  time. 


3. 5. 4. 2. 8  Because  of  difficulties  encountered  in  performing 
the  first  trial  validation,  a  second  validation  was  planned. 

In  this  trial  an  equipment  simulator  and  contractor  tech¬ 
nicians  were  used.  Extreme  care  was  taken  to  control  all 
variables  other  than  those  being  investigated.  The  results 
of  this  trial  showed  a  definite  trend  toward  correlation 
between  EMPT  score  and  down  time,  but  the  relation  failed 

to  be  demonstrated  significantly.  The  data  for  this  trial 
and  its  analysis  was  previously  discussed  in  this  section. 

3. 5. 4. 2. 9  Although  a  number  of  different  personnel  variables 
were  investigated,  only  the  Electronic  Maintenance  Proficiency 
Test  showed  any  evidence  of  being  related  to  the  time  a 
technician  takes  to  locate  and  repair  a  malfunction  in 
electronic  equipment.  This  one  relationship  shows  that  a 
maintenance  skill  does  exist,  and  that  the  equipment  de¬ 
signer  must  consider  the  characteristics  of  the  programmed 
maintenance  personnel  when  designing  electronic  equipment. 
Paragraph  4.3,  Volume  II  of . this  report  describes,  to  a 
limited  degree,  these  characteristics. 

3. 5. 4. 3  Support  Factors  -  In  this  research,  support  para¬ 
meter  data  were  collected  through  the  use  of  checklists. 

These  checklists  were:  Checklist  B,  "Scoring  Manuals, 
Technical  Orders,  and  Instructions";  Checklist  F,  "Scoring 
Supply  Conditions";  Checklist  G,  "Scoring  Test  Equipment 
and  Tools";  and  Checklist  H,  "Scoring  Maintenance  Organi¬ 
zation  and  Facilities  Status."  The  score  distributions 
for  each  of  these  checklists  were  extremely  skewed  and 
could  not  easily  be  transformed  to  the  normal  case.  Be¬ 
cause  of  this  situation  the  scores  for  the  four  checklists 
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war*  combined  into  one  total  support  score  which  resulted 
in  a  distribution  that  was  essentially  nonul.  All  analyses 
%rera  based  on  this  combined  support  score. 

3. 5. 4. 3.1  Method  -  To  detenain*  if  a  relation  existed  be¬ 
tween  the  support  paraaeter  and  down  time,  a  correlation 
was  performed  between  support  score  and  log  active  down 
time.  The  correlation  coefficient  was  found  to  -0.45 
which  is  significant  at  the  IM  level.  Since  a  relation 
was  established,  the  next  step  was  to  find  a  tacfhnigua 

for  determining  the  relative  contribution  of  the  individual 
checklists. 

3. 5. 4. 3. 2  A  number  of  correlation  techniques  were  investi¬ 
gated  for  use  with  the  stqpport  checklists,  and  only  on* 
was  found  applicable  due  to  the  extraoia  concentrations  of 
high  scores.  The  technique  selected  was  the  contingency 
coefficient.  The  process  involved  in  applying  this  tamniqu* 
is  shown  in  Appendix  XI.  Volume  II.  of  this  repolrt.  table 
3.22.  "Support  Checklists  Contingency  Coefficients."  shows 
the  coefficients  calculated  for  each  of  the  support  Check¬ 
lists  with  log  active  down  time.  In  Table  3.22.  the  nuniber 
in  the  upper  left  corner  of  each  cell  is  the  observed  value 
while  the  nusber  in  the  lower  right  corner  is  the  value  to 
be  expected  if  no  relation  exists.  The  results  show  that 
there  is  a  significant  relation  for  Checklists  I.  P.  and  0 
and  log  active  down  time;  but  that  there  is  no  significant 
relation  between  checklist  H  and  log  active  down  time. 

3. 5.4. 3. 3  1 nterore tation  -  Ihe  data  of  TSbl*  3.22  shows 
that  the  correlation  trends . are  negative,  i.e.  active  down 
time  decreases  as  checklist  score  increases.  The  coeffi¬ 
cients  were  tested  for  significance  by  determining  the 
probability  associated  with  the  occurrence  of  values  as 
large  as  the  observed  with  on*  degree  of  freedom.  The 
coefficient  for  checklist  H  is  not  significant.  Since 
the  coefficients  for  B.  F.  and  0  are  essentially  the  same, 
it  is  concluded  that  these  checklists  are  amroxlmataly 
equal  in  their  contribution  to  down  time.  Qieckllst  B 
shows  no  association  with  down  time  so  its  contribution 

is  unknown.  It  should  be  noted  that  the  contingency  co¬ 
efficient  is  only  a  measure  of  association  and  is  not 
directly  cosqparable  to  any  of  the  standard  correlation  r's. 


TABLE  3.22 

SUPPORT  CHECKLISTS  CCEITINOENCY  COEFFICIENTS 


Checklist  E 


Checklist 

Score 

Log  Active  Down  Time 

0.716  -  1.665 

1.665  -  2.615 

T^wal 

0-39 

17 

^,-.-^^23.8 

31 

^^.,^^24.2 

48 

40 

33  ^ 

^^,^^^^26.2 

20 

26.8 

53 

Total 

50 

51 

101 

■  7.34  C  -  0.26 

Checklist  F 


Checklist 

Loo  Active  Down  Time 

Score 

0.716  -  1.665 

1.665  -  2.615 

Total 

6 

19 

0r39 

12.4 

12.6 

25 

44 

32 

40 

^^-"■"^38.4 

76 

Total 

50 

51 

101 

8.71 


C  -  0.28 


TABLE  3.22 
(Continued) 

Checklist  6 
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Log  Active  Down  TisM 

Checklist 

Score 

0.716  -  1.665 

1.665  -  2.615 

Total 

21 

37 

0-51 

^^-^"'28.7 

^^^^^^29. 3 

58 

52 

21.3 

21.7 

43 

Total 

50 

51 

101 

-  9.61  C  -  0.29 


Checklist  H 


"Checklist 

Score 

Log  Active  Down  Time 

0.716  -  1.665 

1.665  -  2.615 

0-66 

27 

32 

59 

67-82 

23 

19  ^ ^ 

42 

Total 

50 

51 

101 

■K 


0.79 


-  0.09 
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Since  It  could  not  be  shown  that  one  checklist  related 
more  significantly  to  down  time  that  another  (except  for 
checklist  H)  an  ordered  feature  list  was  not  developed. 
However.  Section  4.4  of  Volume  II  presents  a  series  of 
Items  to  consider  concerning  the  support  environment 
during  the  design-development  phase. 

3.5.5  Design  Review  Me^ods  -  Maintainability  specif  1- 
catlons  require  that  a  forinal  design  review  program  be 
established  for  each  system/equipment  development,  wi 
To  fulfill  this  requirement,  procedures  for  conducting 
maintainability  design  reviews  and  methods  for  analysing 
equipment  for  maintainability  Improvement  were  developed. 

In  addition,  techniques  for  effecting  t^ade-off  with 
other  system  parameters  %«ere  developed..  These  procedures 
and  techniques  were  developed  from  the  analysis  of  the 
data  collected  during  this  program  and  through  the  Inter¬ 
view  of  equipment  designers  and  maintenance  specialists. 

The  design  review  methods  are  given  In  Section  6,  Volume 
II  of  this  report. 

3.5.6  Demonstration  Testing  -  The  experience  and  data  gained 
from  the  laboratory  studies  conducted  as  part  of  this  pro¬ 
gram  were  used  to  develop  demonstration  test  methods,  niese 
methods  were  directed  at  fulfilling  the  maintainability 
specification  requirements  for  demonstrating  the  achieved 
mean  and  maximum  down  time  for  electronic  system. 

The  methods  and  requirements  for  demonstration  testing  are 
given  In  Section  7,  Volume  II,  of  this  report. 

3.5.7  Field  Data  Acquisition  -  One  of  the  requirements 
for  a  complete  malntalnabiilty  engineering  program  Is  to 
obtain  maintenance  data  from  equipment  under  actual 
operating  conditions.  During  the  field  data  acquisition 
phases  of  this  program,  techniques  ware  developed  for 
gathering  such  data  and  much  experience  was  gained  In  the 
use  of  these  techniques.  These  techniques  have  been  refined 
through  the  knowledge  and  data  gained  from  the  field  programs 
and  general  requirements  for  maintenance  data  have  bean 
defined.  The  procedures  and  guides  for  gathering  maintenance 
data  at  field  locations  are  presented  In  Section  8,  Volume 
II,  of  this  report. 
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4.  CONCLUSION 

4.1  Currant  Staf  of  th«  Art 

ni«  tachnlquaa  and  infomation  darivad  from  this  study  should 
matarlally  assist  tAia  anglnaar  in  his  task  of  davaloplng  a 
systaa  with  good  maintainabili^.  lhasa  taohnlguas  will 
parmlt  tha  quantitativa  traatnant  of  tha  Isqportant  tiaw 
oharaetarl sties  itiharant  to  auilntainabillty.  AssaoasMnt  of 
daaign  faaturas  through  tha  usa  of  tha  ehacflcllst  oritaria, 
parmits  thair  influanoa  on  maintananca  tlsw  to  ba  datarsdnad, 
thus  parmittlng  altarnata  dasigna  to  ba  avaluatad.  Nurthar, 
such  avaluatlon  providas  guidanea  toward  aehiaving  tha  spacl- 
fiad  aaintainabill^  goals.  Idantlflcatlon  of  tha  principal 
factors  influencing  maintananca  task  aeooaqplidusant  directs 
design  effort  toward  those  faaturas  %d\lch  will  yield  f^a 
greatest  maintainability  improvement,  thus  providing  batter 
use  of  the  dollars  invested. 

4.1.1  The  accuracy  of  tha  maintainability  pradiotion  tacho 
nlgua  is  generally  conslstaat  with  that  achievable  with  re¬ 
lated  technologies.  Considering  tha  relatively  short  time 
maintainability  has  received  intensive  investigation,  a 
major  step  has  bean  made  from  a  oomplataly  unknown  quantity 
to  tha  ordered  discipline  ehioh  has  evolved.  The  ability 
to  measure,  apaclfy,  predict,  control,  and  demonstrate 
maintainability  places  it  within  tha  realm  of  an  explicit 
technology. 

4.2  Recommendations  for  Continued  Study 

The  work  %Aiich  must  follow,'  should  taka  tha  course  of  con¬ 
tinued  refinement  of  tha  tadhnology,  thus  far  advanced. 
Specifically,  additional  investigation  ^ould  consider t 

a.  Improvament  in  design  factor  measuremont  techniques 
to  achieve  greater  accuracy  for  the  prediction 
technique . 

b.  Study  of  the  personnel  parameter  to  determine  the  com¬ 
plete  range  of  characteristics  which  influence  tech¬ 
nical  capability. 
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c.  Investigation  of  the  support  environment  to  determine! 
to  a  greater  degree «  its  relation  to  the  design  and 
personnel  factors. 

d.  Determine  the  suitability  of  principles  developed# 
for  application  to  areas  other  than  the  ground  elec¬ 
tronic  environment. 

e.  Investigate  maintainability  problems  associated  with 
mechanical#  pneumatic#  and  hydraulic  systems. 

f.  Develop  expressions  or  techniques  which  will  permit 
the  relating  of  maintainability  to  reliability# 

cost#  and  other  system  parameters  to  be  made  to  achieve 
system  optimization. 

g.  Investigate  the  impact  of  modularization#  integrated 
circuitry#  and  other  new  packaging  techniques  on 
maintainability. 

h.  Improve  maintainability  design  guidelines  to  better 
assist  the  engineer  in  the  selection  of  maintenance 
concepts#  test  equipment  philofophy#  and  related  plan¬ 
ning  requirements. 

i.  Further  examine  the  underlying  distributions  asso¬ 
ciated  with  maintenance  parameters#  to  determine  their 
scope  of  applicability. 

j.  Development  of  more  detailed  indices  for  use  by  the 
equijMnent  designer  and  development  of  an  overall 
measurement  for  maintainability. 

4.3  gjmmSIY. 

Significant  advances  have  been  made  in  understanding  the 
nature  of  the  maintainability  problem  and  in  developing 
analytical  tools  for  quantitative  treatment.  However#  any 
Investigation  of  maintainability  soon  uncovers  the  complexity 
of  the  total  problem  and  it  is  realized  that  only  thorough 
and  continued  research  will  obtain  a  complete  resolution  of 
all  problems.  With  the  recognition  of  the  maintenance 
Impact  on  present  systems  and  the  advancing  complexity  of 
new  programs,  it  is  imperative  that  exploration  of  main¬ 
tainability  be  continued. 
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TABLB  1-2 
FIBLO  DATA 

PHASE  V  NAIMTAIHABILIiy  STUDV 


IfSi. 

Si 

1 

51R01B 

174.1 

2 

51R03B 

3.4 

3 

51R19B 

59.2 

4 

51R20B 

2.7 

5 

51R23B 

116.6 

6 

51R24B 

84.4 

7 

51R25A 

28.9 

8 

51R30B 

20.0 

9 

51R31B 

188.7 

10 

51R33A 

51.1 

11 

51R34B 

156.9 

12 

51R35B 

56.9 

13 

51R36B 

27.0 

14 

51R37B 

62.8 

15 

51R38B 

99.2 

16 

51R39B 

139.0 

17 

51R40B 

224.7 

18 

51R42B 

166.2 

19 

51R43B 

25.5 

20 

51R44B 

114.7 

21 

51R45B 

207.2 

22 

52R02B 

59.5 

23 

51C10B 

111.3 

24 

51C11B 

53.7 

25 

51C12B 

293.2 

26 

51C13B 

30.9 

27 

51C14B 

61.9 

28 

51C15B 

32.7 

29 

51C16B 

75.0 

30 

51C17B 

74.9 

31 

51C18B 

47.9 

32 

51C19B 

32.6 

33 

51C20B 

27.7 

A  A  £ 


2.24080 

18 

17 

IS 

0.53148 

57 

20 

39 

1.77232 

26 

21 

24 

0.43136 

58 

26 

39 

2.06670 

28 

15 

21 

1.92634 

34 

16 

24 

1.46090 

48 

22 

20 

1.30103 

54 

24 

21 

2.27577 

16 

14 

16 

1.70842 

28 

28 

19 

2.19562 

16 

12 

5 

1.75511 

30 

16 

23 

1.43136 

44 

20 

26 

1.79796 

30 

18 

23 

1.99651 

30 

11 

18 

2.14301 

24 

14 

11 

2.35160 

20 

14 

6 

2.22063 

29 

IS 

21 

1.40G54 

42 

26 

23 

2.05956 

22 

11 

18 

2.31639 

18 

14 

15 

1.77452 

31 

14 

18 

2.04650 

28 

15 

18 

1.72997 

36 

18 

22 

2.46716 

22 

8 

16 

1.48996 

43 

19 

27 

1.79169 

40 

16 

24 

1.51455 

33 

14 

28 

1.87506 

32 

14 

24 

1.87448 

39 

10 

23 

1.68034 

42 

13 

29 

1.51322 

41 

21 

30 

1.44248 

41 

21 

31 

99 


TABU  X-2 
FIIU  DATA 

PHA8B  V  MAIHTAIIIABILITT  STUDY 
Corractlv  lUinfnMtoB  (Continusd) 


MOi. 

Tatk 

34 

51C21A 

13.8 

35 

51C22B 

24.5 

36 

51C23B 

23.6 

37 

51C24B 

57.1 

38 

51C26B 

15.1 

39 

51C27B 

35.9 

40 

51C28B 

142.3 

41 

51C29B 

221.5 

42 

51C30A 

104.0 

43 

31C31B 

89.0 

44 

51C32A 

13.1 

45 

51C33B 

76.7 

46 

91C34B 

47.6 

47 

51C35B 

25.9 

48 

51C36A 

19.5 

49 

51C37B 

18.5 

50 

51C38B 

14.2 

51 

51C40B 

18.0 

52 

51C41B 

53.1 

53 

51C42A 

88.1 

54 

51C43B 

124.5 

55 

51C44B 

32.8 

56 

51C45B 

61.2 

57 

51C46B 

90.7 

58 

51C47B 

113.5 

59 

51C48B 

38.8 

60 

52C01B 

15.3 

61 

52C02B 

23.4 

62 

52C03B 

88.8 

L 

A 

fi 

1.13988 

43 

25 

36 

1.38917 

44 

20 

31 

1.37291 

39 

20 

30 

1.75664 

33 

16 

24 

1.17898 

45 

23 

32 

1.55509 

37 

19 

32 

2.15320 

20 

21 

22 

2.34537 

22 

14 

li 

2.01703 

20 

26 

21 

1.94939 

31 

13 

27 

1.11727 

41 

25 

40 

1.88480 

35 

12 

24 

1.67761 

34 

17 

31 

1.41330 

39 

21 

34 

1.29003 

43 

25 

32 

1.26717 

43 

21 

31 

1.15229 

45 

24 

36 

1.25527 

45 

23 

36 

1.72509 

37 

14 

24 

1.94498 

32 

19 

20 

2.09517 

30 

15 

13 

1.51587 

37 

21 

28 

1.78675 

36 

18 

19 

1.95761 

27 

17 

21 

2.05500 

30 

15 

16 

1.58883 

33 

23 

28 

1.18469 

42 

24 

24 

1.36922 

50 

24 

24 

1.94841 

46 

18 

20 
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TAftU  X-3 

•nu  or  sonmif.  raooocn.  nc. 


Oparatlen 

O.OIA 

O.OIB 

O.OIC 

s_ 

7.03 

3.88 

4.45 

R 

••r 

2.6055 

0.7370 

1.0401 

88Dp 

2.24640 

0.60429 

0.90011 

0.35910 

0.05351 

0.13999 

•c 

“e 

14.56 

5.5194 

7.42 

1.4562 

10.46 

2.0912 

88D^ 

c 

5.29984 

1.37641 

2.73539 

0.21956 

0.07979 

0.15591 

"a-r 

Vi/” 

"Vr 

1.3317 

1.23904 

0.09106 

1.5993 

1.42190 

0.17722 

"a-c  . 
8.84/40 

«~A.C 

2.7515 

2.70000 

0.05062 

3.9214 

3.00744 

0.11396 

»'b-r 

8,8^/22 

«»»B-R 

0.0323 

0.70403 

0.04740 

”b-c 

"°B-C 

2.0032 

1.94033 

0.06207 

1 

39.16303 

75.49473 

69.71079 

5.77593 

66.51343 

115.30031 

110.59750 

4.71043 

11.10360 

13.51466 

-  1.33190 

33.30464 

34.31053 

-  0.83500 

6.53154 

6.90709 

-  0.30556 

11.90606 

13.33006 

-  0.43130 


"'C-R 

8cSi/32 

"Dc-r 


SP, 


c-c 


8cSi/40 


SPO 


c-c 


7.15030 

7.93179 

-  0.77159 

16.66371 

17.39300 

-  0.73929 


0.01710 

0.13077 

0.00255 

0.05048 

0.00667 

0.08165 

0.27504 

0.52445 

0.31955 

0.17636 

0.20227 

1.78018 

0.41 

0.29 

0.40 

0.29 

0.00563 

0.00205 

0.00400 

0.11777 

0.07503 

0.04523 

0.06323 

0.34317 

0.36400 

0.18550 

0.26150 

1.66281 

0.21 

0.24 

0.24 

0.21 

101 


I 

I 

I 

I 

I 

r 

I 

I 

APPBMDIX  II 

I  EWT  SATA 

I 

i: 

i 

1 

1. 

L 

L 

L 

I 


103 


LIST  or  TABUS 

smom. 

II  -  1  Biographical  Data  105 

II  -  2  Tost  -  Task  6  -  Blamonts  -  M  ■  40  108 

II  -  3  Ratast  -  Tack  6  -  Blananta  -  H  -  40  109 

11-4  Taat  -  Task  1  -  Blamanta  -  B  ■  25  110 

11-5  Ratast  -  Task  1  -  Blamants  -  II  ■  25  111 

11-6  Taat  -  Task  2  -  Blamants  -  H  ■  25  112 

11-7  Ratast  -  Task  2  -  Blamants  -11-25  113 

11-8  Tast  -  Task  3  -  Blamants  -11-25  114 

11-9  Ratast  -  Task  3  -  Blamants  -11-25  115 

11  -  10  Tast  -  Task  4  -  Blamants  -11  —  25  116 

11  -  11  Ratast  -  Task  4  -  Blamants  -11-25  117 

II  -  12  Tast  -  Task  5  -  Blamants  -11  —  25  118 

11  —  13  Ratast  —  Task  5  —  Blamants  -  H  —  25  119 

11  -  14  BMPT  Scoras  120 

II  -  15  Log  Valua  of  121 


I 


105 


§ 

1 

« 

i 

•H 

1 

Civilian 

ni 

• 

• 

a 

t4 

>1 

« 

M 

>« 

V 

A. 

• 

1  i 

a 

a 

a 

• 

&  ^ 
H  M 

ia 

a 

8 

A 

Co. 

Slec. 

6  yrs. 

« 

e 

u 

>i 

in 

• 

e 

?ii 

V 

•  • 

•  a 

4  P 
>1  >1 

V 

1 

1 

3  yrs. 

a  r 

1 

2  yrs. 

a 

a 

Military 

■tfl 

KU 

s 

2  yrs. 

a  i 

1  a 

a 

a 

a 

a  i 

s  a 

2  yrs. 

a 

a 

• 

M 

• 

.c 

■ 

>1 

M 

£ 

■ 

i 

i  a 

6  yra 

s 

>1 

M 

in  a 
in  si 

Bl 

a 

a 

a 

Training 

Civilian 

Corr. 

Sch. 

S 

3  yrs 

& 

a  t 

1  a 

,a 

a 

a 

a  i 

1 

a 

a 

Radio 

Sch. 

S 

n 

s 

u 

>i 

s 

0 

M  r 

•  • 

t  a 

4  u 

h  >i 

>1  N 

• 

a 

si 

a 

a 

a  i 

i  a 

3  yrs. 

2  yrs. 

a 

Tech. 

Sch. 

s 

S 

s 

3  yrs. 

• 

M 

^  ( 
H  a 

2  yrs. 

a 

a 

• 

M 

►l 

H 

1  yr. 

II 

1 

£ 

H 

II 

Military 

• 

H 

s 

T 

t 

>1^ 
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* 
H'-’ 

S 

s 

S 

s 

« 

i  SB 

a 

a 

a 

a  i 

i 

1 

a 

a 

• 

1 

a 

« 

Sh 

s 

n 

Ps 
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• 

^  SB 

a 

$ 
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a* 

11 

II 

Radio 

a 

1* 
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• 

n 

p 

tJm 

■ 

I 

S  a 
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• 

a 

M 

5 
n  SB 

a 

S“: 

P  10 
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Ip 

EZZ 

1 

a 

s> 
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• 

PV  P 

ll 

• 

M 

P  V 

1 
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« 
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s 

CO 

1 

u 

■ 

E4 

H 

s 

w 

CO 

S  1 

CO  i 

§ 

& 

s 

s 

CO 

V 

•P 

& 

5  Mar 
1956 

■  IT 
(M  9 
M  H 

18  May 
1959 

I 

M 

Ki 

20  Oct 
1959 

26  Mar 

1956 

25  June 
1962 

18  June 
1962 

I 

IMm 

15  Apr 
1959 

16  July 

1956 

10  Sept 
1961 

10 
m  9* 
N  H 

■M 

a  91 
in 
vO  91 
d  H 

17  Dec 
1958 

• 

s 

B 

'(N 

m 

fl 

m  II 

n 

a 

o\ 

O 

H 

H  f 

H  p 

>1  n 

4  H 

H 

in 

H 

a 
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TABLE  II -2 

TEST  TASK  6  -  ELEMENTS -N'-40 


TABLE  11-3 

RBTB8T-TASK  6  -  BLBIUaiTS-M-40 


Blmant 


T«chnlclan 


Total 


.3 
4.8 

9.7 

13.7 

6.7 

8.3 

15.8 

20.9 

6.3 

4.4 
28.0 


1.3118 

1.3560 

0.8216 

1.7033 

1.2122 

0.9777 

1.1644 

0.6902 

1.8014 

0.7993 

0.9243 

0.9823 

0.9191 

0.9138 

1.1038 

1.3201 

0.6812 

1.0453 

0.9395 

1.4579 

1.19C’ 

1.1430 

0.9777 

1.5729 

1.1818 

1.2227 

0.7559 

0.8808 

1.0569 

0.6335 

0.6812 

0.9868 

1.1367 

0.8261 

0.9191 

1.1987 

1.3201 

0.7993 

0.6435 

1.4472 


14.2 

44.4 

2.39 

7.50 

1.4843 

1.3655 

1.8603 

22.9 

1.3598 

40.9 

1.6117 

30.8 

1.4886 

17.4 

1.2405 

20.9 

1.3201 

20.5 

1.3118 

11.1 

1.0453 

45.8 

1.6609 

23.8 

1.3766 

16.2 

1.2095 

9.2 

0.9638 

17.2 

1.2355 

23.9 

1.3784 

56.5 

1.7482 

27.8 

1.4440 

12.5 

1.0969 

48.0 

1.6812 

39.4 

1.5955 

15.3 

1.1847 

27.0 

1.4314 

11.0 

1.0414 

20.4 

1.3096 

684.7 

34.4455 

TABLB  II-5 

RETEST  TASK  1  -  ELBHEIITS-N-25 


■■■■ 

Elwaant  | 

Total 

■■ 

T«chnlclar 

1 

2 

3 

4 

5 

1 

0.0 

5.5 

0.0 

1.0 

3.0 

0.9777 

2 

0.0 

6.9 

0.9 

0.4 

6.0 

1.1523 

4 

0.8 

13.8 

2.7 

1.1 

1.3874 

5 

0.1 

5.1 

0.1 

0.7 

1.0792 

7 

0.0 

10.5 

0.3 

0.3 

1.2330 

9 

0.2 

6.6 

0.0 

1.3 

11.1 

1.0453 

12 

0.1 

8.7 

0.7 

1.0 

16.5 

1.2175 

15 

0.0 

4.4 

0.1 

0.4 

10.9 

1.0374 

18 

0.0 

27.4 

2.9 

0.4 

36.7 

1.5647 

19 

0.0 

3.4 

0.1 

0.7 

0.8573 

20 

0.3 

6.2 

0.1 

0.8 

6.0 

1.1271 

21 

0.0 

6.7 

0.3 

3.0 

10.3 

1.0128 

22 

0.0 

9.2 

0.3 

3.0 

13.5 

1.1303 

23 

0.0 

3.1 

0.0 

3.0 

6.2 

0.7924 

27 

0.0 

26.5 

1.2 

msM 

15.0 

45.1 

1.6542 

28 

0.0 

2.4 

0.0 

0.2 

3.0 

5.6 

0.7482 

29 

0.0 

6.9 

0.0 

0.5 

3.0 

10.4 

1.0170 

32 

0.0 

7.4 

0.0 

0.2 

3.0 

10.6 

1.0253 

33 

0.0 

1.2 

0.9 

6.0 

25.5 

1.4065 

34 

0.0 

0.1 

0.6 

3.0 

5.3 

0.7243 

35 

0.0 

0.1 

0.3 

3.0 

7.6 

0.8808 

36 

0.2 

0.1 

0.7 

3.0 

8.4 

0.9243 

37 

0.0 

0.2 

0.4 

9.0 

21.5 

1.3324 

38 

0.0 

0.6 

6.0 

13.0 

1.1139 

39 

HI 

0.0 

0.3 

3.0 

4.8 

0.6812 

Total 

a 

208.1 

11.4 

16.6 

123.0 

360.8 

26.1225 
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TABLE 
TEST  TASK  2  - 


0.00 


43.45 


0.00 


CM  iH  CM  CM 


II-6 


ELEMBMT8-N-2S 


4 


5 


Total 


Log  Total! 


0.1 

0.3 

0.0 

0.1 

0.1 

0.1 

0.1 

0.3 

0.1 

0.1 

0.1 

0.1 

0.1 

0.1 

0.2 

0.1 

0.1 

0.1 

0.1 

0.1 

0.1 


3.0 

3.0 

3.0 

3.0 

3:0 

3.0 

3.0 

3.0 

3.0 

3.0 

3.0 

3.0 

3.0 

3.0 

3.0 

3.0 

3.0 

3.0 

6.0 

3.0 

3.0 

3.0 

3.0 

3.0 

3.0 


7.9 

6.6 

9.2 
4.8 
4.8 

7.5 

5.5 

6.B 

5.7 

4.1 

4.7 

5.6 

6.4 

4.4 

4.8 

4.8 

3.7 
5.0 

14.3 

5.3 

4.2 

6.0 

3.4 
4.2 

3.9 


0.8976 

0.8195 

0.9638 

0.6812 

0.6812 

0.8751 

0.7404 

0.8325 

0.7559 

0.6128 

0.6721 

0.7482 

0.8062 

0.6435 

0.6812 

0.6812 

0.5682 

0.6990 

1.1553 

0.7243 

0.6232 

0.7782 

0.5315 

0.6232 

0.5911 


3.2 


78.0 


143.6 


18.3864 


2.23 


54.32 


100.0 
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TABU  II -7 

2  >  BXiBMBmS-N-25 


tlMMnt 

Total 

3 

4 

5 

0.0 

3.0 

4.3 

0.6335 

0.0 

3.0 

4.0 

0.6021 

0.0 

3.0 

6.9 

0.8389 

0.0 

3.0 

3.4 

0.5315 

0.0 

0.2 

3.0 

4.2 

0.6232 

0.0 

0.1 

3.0 

3.7 

0.5682 

0.0 

0.1 

3.0 

4.7 

0.6721 

0.0 

0.1 

3.0 

4.3 

0.6335 

0.0 

0.1 

3.0 

5.9 

0.7709 

0.0 

0.1 

3.0 

3.6 

0.5563 

0.0 

0.1 

3.0 

3.3 

0.5185 

0.0 

0.1 

3.0 

5.1 

0.7076 

0.0 

0.2 

6.0 

11.5 

1.0607 

0.0 

0.1 

3.0 

3.2 

0.5051 

0.0 

0.1 

3.0 

4.1 

0.6128 

0.0 

0.2 

3.0 

7.9 

0.8976 

0.0 

0.1 

3.0 

3.9 

0.5911 

0.0 

0.1 

3.0 

4.7 

0.6721 

0.0 

0.1 

3.0 

25.3 

1.4031 

0.0 

0.1 

3.0 

3.9 

:  0.5911 

0.0 

0.1 

3.0 

3.5 

0.5441 

0;0 

0.8 

6.0 

8.9 

0.9494 

0.0 

0.1 

3.0 

3.2 

0.5051 

0.0 

3.0 

4.0 

0.6021 

0.0 

12.0 

23.7 

1.3747 

D1 

D 

90.0 

161.2 

17.9653 

0.00 


3.10 


55.84 


100.0 
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TABLE  II -8 

TEST  TASK  3  •>  ELEMENTS-N-25 


115 


TABIii  IX-9 

RETEST  TASK  3  -  BLBNBMTS-E-25 


33.40 


0.00 


9.34 


57.26 


100.0 


116 


TABLE  II -II 
TEST  TASK  4  -  ELEMl 


Tachniclan 

Elcnent 

1 

2 

3 

4 

1 

0.0 

2.7 

0.0 

0.5 

2 

0.0 

1.6 

0.0 

0.1 

4 

0.0 

16.6 

0.0 

0.3 

5 

0.0 

0.7 

0.0 

0.2 

7 

0.0 

9.7 

0.0 

0.1 

9 

0.0 

3.7 

0.0 

1.2 

12 

0.0 

0.9 

0.0 

0.3 

15 

0.0 

2.2 

0.0 

0.6 

18 

0.0 

1.7 

0.0 

0.1 

19 

0.0 

3.0 

0.0 

0.3 

20 

0.0 

4.3 

0.0 

0.1 

21 

0.0 

1.5 

0.0 

0.3 

22 

0.0 

2.4 

0.0 

1.4 

23 

0.0 

4.7 

0.0 

0.2 

27 

0.0 

1.5 

0.0 

0.0 

28 

0.0 

4.8 

0.0 

2.0 

29 

0.0 

11.1 

0.0 

0.1 

32 

0.0 

1.5 

0.0 

33 

0.0 

22.9 

0.0 

1.8 

34 

0.0 

5.7 

0.0 

0.1 

35 

0.0 

3.3 

0.0 

0.1 

36 

0.0 

3.9 

0.0 

0.2 

37 

0.0 

6.8 

0.0 

0.1 

38 

0.0 

3.3 

0.0 

0.1 

39 

0.0 

2.1 

0.1 

0.2 

Total 

mm 

122.6 

■9i 

10.4 

% 

0.00 

55.70 

0.04 

4.73 

«-25 


“n 

5 

■■ 

1 

3.0 

— 

6.2 

0.7924 

3.0 

4.7 

0.6721 

3.0 

19.9 

1.2989 

3.0 

3.9 

0.5911 

3.0 

12.8 

1.1072 

3.0 

7.9 

0.8976 

3.0 

4.2 

0.6232 

3.0 

5.8 

0.7634 

3.0 

4.8 

0.6812 

3.0 

mam 

0.7993 

3.0 

0.8692 

3.0 

4.8 

0.6812 

3.0 

6.8 

0.8387 

3.0 

7.9 

0.8976 

3.0 

4.5 

0.6532 

3.0 

9.8 

0.9912 

3.0 

14.2 

1.1523 

3.0 

4.5 

0.6532 

15.0 

39.7 

1.5988 

mSm 

8.8 

0.9445 

6.4 

0.8062 

mSm 

7.1 

0.8513 

KSfl 

9.9 

0.9996 

SSl 

6.4 

0.8062 

5.4 

0.7324 

87.0 

220.1 

21.7100 

r 

39.53 

100.0 
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TABLE 
RETEST  TASK 


0.10 


51.19 


0.00 
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Log  Tota 


0.7076 

0.7160 

1.0066 

0.8129 

0.6335 

0.8325 

0.6721 

0.8451 

1.2981 

0.7482 

1.4116 

1.1271 

0.7634 

0.6532 

0.6435 

0.6021 

0.7324 

0.9138 

0.7404 

0.6628 

0.6990 

1.3404 

0.6990 

0.6335 

0.5051 


20.4019 
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TABl 


TEST  TASK  5 


MM 

Element 

1 

2 

3 

1 

0.0 

0.8 

0.0 

2 

0.0 

0.9 

0.0 

4 

0.0 

8.2 

0.0 

5 

0.0 

2.6 

0.0 

7 

0.0 

4.2 

9 

0.0 

4.3 

12 

0.0 

1.3 

15 

0.0 

3.4 

18 

0.0 

2.1 

19 

0.0 

2.7 

20 

0.0 

4.8 

21 

0.0 

1.9 

0.0 

22 

0.0 

20.8 

0.0 

23 

0.0 

1.5 

0.0 

27 

0.0 

0.6 

0.0 

28 

0.0 

6.8 

0.0 

29 

0.0 

0.8 

0.0 

32 

0.0 

3.0 

0.0 

33 

0.0 

14.7 

0.0 

34 

0.0 

0.0 

35 

0.0 

0.0 

36 

0.0 

0.0 

37 

0.0 

0.0 

38 

0.0 

2.1 

0.0 

39 

0.0 

2.8 

0.0 

Total 

imiQQi 

102.8 

1^11 

% 

0.00 

46.05 

0.00 

11-12 


-  ELBMENTS-N-25 


4 

5 

Total 

0.2 

3.0 

4.0 

0.6021 

0.2 

3.0 

4.1 

0.6128 

3.0 

9.0 

20.2 

1.3054 

0.1 

3.0 

5.7 

0.7559 

3.0 

7.7 

0.8865 

3.6 

11.2 

1.0492 

mSm 

3.0 

4.5 

0.6532 

3.0 

mam 

0.8261 

K9 

3,0 

WSM 

0.7324 

■h 

3.0 

0.7924 

■an 

3.0 

8.0 

0.9031 

0.1 

3.0 

5.0 

0.6990 

2.8 

18.0 

41.6 

1.6191 

0.1 

3.0 

4.6 

0.6628 

0.2 

3.0 

3.8 

0.5798 

2.0 

3.0 

11.8 

1.0719 

0.6 

3.0 

4.4 

0.6435 

0.2 

6.0 

9.2 

0.9838 

1.3 

3.0 

19.0 

1.2788 

0.2 

3.0 

6.5 

0.8129 

0.1 

3.0 

4.4 

0.6435 

0.4 

3.0 

6.4 

0.8062 

0.2 

3.0 

8.1 

0.9085 

0.3 

3.0 

0.7324 

0.5 

6.0 

0.9685 

18.4 

102.0 

223.2 

21.5298 

8.25 

45.70 

100.0 

TABLE  ] 
RETEST  TASK  5  - 


Element 


1 

2 

3 

1 

0.0 

1.2 

0.0 

2 

0.0 

0.6 

0.0 

4 

0.2 

4.8 

0.0 

5 

0.0 

0.7 

0.0 

7 

0.0 

1  3 

0.0 

9 

0.0 

1.2 

0.0 

12 

0.0 

1.2 

0.0 

15 

0.0 

0.9 

0.0 

18 

0.0 

1.4 

0.0 

19 

0.0 

1.3 

0.0 

20 

0.0 

Bsl 

0.0 

21 

0.0 

0.0 

22 

0.0 

0.0 

23 

0.0 

0.0 

27 

0.0 

0.0 

28 

0.3 

0.1 

29 

0.0 

mesM 

0.0 

32 

0.0 

1.8 

0.0 

33 

0.0 

3.0 

0.0 

34 

0.0 

2.7 

0.0 

35 

0.0 

2.0 

0.0 

36 

0.0 

5.5 

0.0 

37 

0.0 

3.3 

0.1 

38 

0.0 

0.9 

0.0 

39 

0.0 

7.9 

0.0 

Total 

D 

61.5 

■a 

% 


0.30 


37.04 


0.12 
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Total 

Mi 

4.5 

0.6532 

4.0 

0.6021 

11.5 

1.0607 

3.8 

0.5798 

4.5 

0.6532 

7.2 

0.8573 

4.7 

0.6721 

4.3 

0.6335 

4.6 

0.6628 

4.9 

0.6902 

4.8 

0.6812 

3.6 

0.5563 

7.2 

0.8573 

4.1 

0,6128 

3.5 

0.5441 

28.2 

1.4502 

4.2 

0.6232 

4.9 

0.6902 

6.5 

0.8129 

5.8 

0.7634 

5.1 

0.7076 

8.6 

0.9345 

6.8 

0.8261 

4.1 

0.6128  ' 

14.6 

1.1644 

166.0 

18.9019 

100.0 

123 


OISTRIBUTI(»l  LIST 

RADC  TOR  63-85  Vol.  I  AF30 <602) -2057 


RADC  (RA80R.  ATTNt  P.  Maszola) 
Orlfflaa  APB  NY 

RADC  (RAAPT) 

Grifflss  APB  NY 

RADC  (RAALO) 

Orlfflaa  APB  NY 

GEEIA  (ROZMCAT) 

Orlfflaa  APB  NY 

RADC  (RAIS,  ATTNt  Mr.  Mallc^) 
Orlfflaa  APB  NY 

US  Army  Electronlca  R&D  Laba 

Llalaon  Officer 

RADC 

Orlfflaa  APB  NY 

AUL  (3T) 

Maxwell  APB  Ala 

ASD  (ASAPRO) 

Wrlght-Patteraon  APB  Ohio 

Chief,  Naval  Reaearch  Lab 
ATTNt  Code  2027 
Waah  25  DC 

Air  Porce  Pleld  Ropreaentatlve 
Naval  Reaearch  Lab 
ATTNt  Code  1010 
Waah  25  DC 

Commanding  Officer 
US  Army  Electronlca  R&D  Laba 
ATTNt  SELRA/SL-ADT 
Ft  Monmouth  NJ 


Wfft  gg  COPiBB 

all  remaining 
copiea 


1 

1 

1 

1 

1 


1 

1 

1 


1 


1 


National  Aaronautlca  &  Spaca  Adxaln 
Langley  Research  Center 
Langley  Station 
Hampton  Virginia 
ATTVIt  Librarian 

RTD  (RTGS) 

Bolling  ATB 
Wash  25  DC 

AFSC  (SCSE) 

Andrews  AFB 
Wash  25  DC 

A8TIA  (T18IA-2) 

Arlington  Hall  Station 
Arlington  12  VA 

Hq  USAF  (AFCQA) 

Wash  25  DC 

Bureau  of  Naval  Weapons 
Main  Navy  Bldg 
Wash  25  DC 

ATTOt  Technical  Ubrarian,  OLl-3 

Redstone  Scientific  Information  Center 
US  Army  Missile  Ccmmand 
Redstone  Arsenal «  Alabama 

ADC  (ADOAC-DL) 

Ent  AFB  Colo 

BSD  (ESSTE-2/ttaj  Barton) 

L  O  Hanscom  Fid 
Bedford  Mass 

Department  of  Defense 

Office  of  Maintenance  Engineering 

ATTNt  A.  L.  Jackson«  Jr.  ODDR&E 

Room  3D1018 ,  Pentagon 

Wash  25  D  C 

ASD  (ASMlR/hr.  Scholl) 

Wrlght-Patterson  AFB  Ohio 
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OCAS  (MCTh/Hx.  Kurth)  1 

AP  Unit  Post  Offlcs 
Los  Angeles  45  Calif 

Department  of  Defense  1 

OA8D  Por  Research  &  Engineering 
ATTNt  Mr.  B.  Nucci,  OODR&B) 

Wash  25  D  C 

USAP  (APMMB>AR/kr.  S.  Hirshon)  1 

Wash  25  D  C 

APLC  (MCPB/Mr.  Littler)  1 

Wright-Patterson  APB  Ohio 

USAP  (APMMB-AM/Col  Pallon)  1 

Wash  25  O  C 

BSD  (BSROB/kaj  Van  Hbrn)  1 

Ii  Q  Hanacom  Pld 
Bedford  Mass 

APSC  (SCSMR/kr.  Wenger)  1 

Ar;drews  APB 
Wash  25  O  C 

APSC  (SCSNR/Maj  Crumpacker)  1 

Andrews  APB 
Wash  25  0  C 

Weapon  System  Evaluation  Group  1 

Pentagon 

Wash  25  D  C 

SSO  (SSSIR/Wr.  John  Shook)  1 

Norton  APB  Calif 

SSO  (SSOCO/Capt  Leslie  Rutherford)  1 

Norton  APB  Calif 

A8D  (MRPEM/Wr.  L.  T.  Pope)  1 

6570th  Aerospace  Medical  Research  Lab 
Wright-Patterson  APB  Ohio 


